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1. 


Introduction 


The  missile  map-matching  problem  for  guidance  updating  or  target  homing  is  shown  in  Figure  1,  The 
problem  as  defined  here  consists  of  locating  the  position  of  a  sensor  image  relative  to  a  reference  map 
which  is  stored  onboard  the  vehicle's  computer.  Once  the  match  location  is  found  the  relative  location 
between  the  two  map  centers  can  be  used  to  update  the  vehicle's  navigational  position.  The  two  important 
\  performance  considerations  are  the  avoidance  of  false  fixes  as  measured  by  their  frequency  of  occurrence 
V^^and  the  accuracy  with  which  the  position  fix  can  be  made. 
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This  paper  describes  the  overall  design  and  evaluation  of  map-matching  systems,  (For  additional  back¬ 
ground  information,  the  reader  is  referred  to  references  1  -  10. )  Figure  2  shows  th6  layout  of  a  typical 
system  design.  Here  the  system  parameters  associated  with  the  reference  data,  sensor  environment  and 
vehicle  are  integrated  to  determine  a  model  of  the  image  dynamics.  This  model  usep  in  conjunction  with  a 
signature  prediction  model  is  used  to  construct  the  reference  map  or  set  of  reference  maps  to  be  stored  on 
the  vehicle.  / 


In  the  map-matching  problem  a  number  of  errors  can  develop  between  the  sensed  image  onboard  the 
missile  platform  and  the  image  reference  map  stored  in  the  vehicle  computer.  Those  errors  can  be 
categorized  into  four  generic  classes  depending  on  their  impact  on  the  composition  of  the  sensed  image 
relative  to  the  reference  map.  Global  errors  which  impact  all  elements  in  the  sensed  image  are  generally 
accommodated  by  preprocessing  while  all  other  types  of  errors  must  be  accommodated  by  the  choice  of  the 
matching  algorithm.  The  scene  selection  process  is  important  for  determining  that  the  reference  map  area 
contains  sufficient  information  of  a  nonredundant  nature  to  successfully  perform  the  matching  task.  The 
scene  selection  process  consists  of  a  two  part  screening  process.  The  first  part  consists  of  various 
mathematical  tests  which  determine  to  a  first  level  the  amount  of  independent  information  and 
redundancy  within  the  scene.  The  second  part  consists  of  simulation  to  determine  the  acceptability  of  the 
scene  under  real  world  flight  conditions.  Finally,  3.  system  verification  process  is  required  to  determine 
from  the  nature  of  the  matching  data  whether  a  successful  match  has  taken  place  and  if  not,  what  appropriate 
action  should  be  taken, 

This  paper  is  divided  into  four  additional  sectionsf^/Section  2  describes  the  problems  associated  with 
describing  a  scene  mathematically  and  with  the  time  and  spatial-varying  nature  of  scene  signature  fcr 
various  sensor  types.  This  section  describes  the  nature  of  environmental  factors  on  image  dynamics  and 
their  impact  which  can  be  measured  in  terms  of  predictive  errors,  nonstructured  errors,  and  contrast 
reversals  for  various  sensor  wavelengths.  Finally,  remedies  are  discussed  which  can  mitigate  the  effects 
of  errors  due  to  image  dynamics. 


S^Section  3  describes  the  problems  associated  with  inference  map  construction  and  discusses  the  scene 
selection  process  by  which^good1^  reference  scenes  are  progressively  screened  out  from  those  that  are 
^not  so  good”. 

J 

^Section  4  describes  the  compatibility  of  various  classes  of  algorithms  to  accommodate  each  of  the  four 
categories  of  error  sources.  Ultimately,  since  the  magnitude  cf  these  errors  is  sensor  dependent,  this 
section  cros correlates  algorithm  appropriateness  for  each  sensor  wavelength.^ 

S* Finally,  Section  5  describes  the  mathematical  process  behind  developing  measures  for  system  perform¬ 
ance.  This  section  is  divided  into  two  parts,  Jn  the  first  part  the  general  scene/error  model  is  discussed 
and  a  mathematical  approach  (through  a  list  assumptions  and  approximations)  is  outlined  which  can  be 
used  to  predict  the  probability  of  false  match  occurrence  baaed  on  a  number  of  system  parameters.  In  the 
second  part  of  the  section,  one  is  concerned  with  (given  a  particular  scene)  using  the  statistical  data  from 
the  map-matching  algorithm  to  estimate  the  system  performance  in  near  real-time 
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Figure  2,  Overall  map-matching  system  design 
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Imase  dynamic*  and  It*  Impact  on  comp*rl»on  of  *en*ed  image  and  reference  ma 


Indicated  in  the  figure,  the  aenior /image  Interaction  la  Influenced  by  a  number  of  environmental  factor*. 
Thete  factor*,  combined  with  inherent  time-varying  material  physical  and  electrical  properties,  produce  an 
oscillation  in  the  scene  signature.  Dynamic  change*  in  the  sensor  scene  when  compared  to  a  time- 
stationary  reference  scene  can  cause  significant  error*  to  exist  between  the  two  maps.  These  errors,  if 
unaccounted  for,  are  generally  a  major  cause  of  failure  in  map-matching  systems. 

It  is  the  purpose  of  this  section  of  the  paper  to: 

1,  describe  the  scene  composition, 

2,  discuss  the  impact  of  environmental  and  inherent  scene  factors  on  signature  dynamics, 

3.  discuss  and  quantify  the  nature  of  the  map  difference  errors  when  sensed  and  reference  map 
are  compared,  and 

4.  outline  remedies  for  accommodating  map  difference  errors  in  the  system. 

As  the  influence  of  the  environmental  and  inherent  scene  factors  is  wavelength  or  frequency  dependent, 
the  discussion  will  focus  on  the  most  common  active  and  passive  sensor  categories  (i.  e.  ,  optical/near  IR, 
middle  IR,  thermal  IB.,  and  microwave). 

The  following  section  will  describe  the  reference  map  selection  process  including  methods  for  choosing 
reference  maps  to  reduce  the  map  difference  problem.  The  subsequent  section  will  discuss  the  role  of 
various  types  of  algorithms  in  accommodating  map  difference  algorithm  and  other  types  of  system  errors. 
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Figure  3.  The  impact  of  image  dynamics  on  map  comparison 
2.  1  Composition  of  the  scene 

The  scene  is  the  most  complex  component  of  the  map-matching  problem  and  the  most  difficult  to  model. 
Scenes  can  be  described  in  the  visual  domain  (the  eyeball  process)  as  being  composed  of  a  set  of  features. 
Actual  sensor  data,  broken  down  by  resolution  elements,  are  described  by  a  set  of  intensity  values.  There 
are  regions  of  intensity  values  in  the  scene  which  can  be  considered  aralogous  to  features  in  the  visual 
domain.  These  are  homogeneous  regions*  within  the  scene  which  can  be  considered  equivalent  to  features 
(because  a  feature  can  be  defined  by  a  single  homogeneous  region  or  set  of  homogeneous  regions).  From  a 
physical  standpoint,  homogeneous  regions  are  areas  in  which  die  signature  (reflectance  lor  visual  and  radar, 
emitted  power  for  middle  and  thermal  IR,  and  altitude  for  terrain  contours)  is  expected  to  remain  fairly 
constant,  e. g. ,  a  grassy  field  in  which  all  the  elements  in  the  region  are  expected  to  have  the  same  mean 
value  but  not  necessarily  a  constant  value. 

There  exist  variations  in  the  intensity  level  within  a  ho-  ogeneous  region.  Neglecting  the  possibility  of 
sensor  noise,  this  signature  variation  can  be  -attributed  to  either  scene  resolution  constraints  or  texture 
variation  within  the  region.  Scene  resolution  constraints  can  cause  a  perturbation  in  the  signature  of  the 

*  We  define  a  homogeneous  region  to  be  a  set  of  spatially  connected  pixels  or  elements  which  possess  the 
statistical  property  of  at  least  first-order  stationarity  (constant  mean  intensity  level  over  the  region)  and 
possibly  second-order  stationarity  (mean  and  variance  constant  and  autocorrelation  Independent  of  position). 
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r eg ion.  For  instance,  one  can  consider  the  greasy  field  not  to  be  uniform  but  ineteed  to  have  e  few  fallen 
tree  trunks  and  shrubs  dispersed  within  it.  If  the  ground  resolution  of  the  eensor  is  of  the  same  magnitude 
as  the  sice  of  the  shrubs  and  trse  turnks,  than  we  would  expect  variations  in  the  intensity  of  the  grassy 
regions  due  to  these  objects.  *  lit  should  be  noted  that  if  the  resolution  of  the  sensor  were  to  increase  to  the 
point  that  dimensions  of  objects  within  the  grassy  field  covered  several  sensor  resolution  elements,  then 
these  objects  would  be  considered  homogeneous  regions  in  themselves.  In  our  tree  trunk  example,  further 
Increase  in  sensor  resolution  would  result  eventually  in  the  moss  on  the  fallen  tree  trunk  becoming  a 
homogeneous  region.  .Obviously,  the  process  of  identifying  homogeneous  regions  could  continue  ad  infinitum 
as  the  sensor  resolution  was  increased. 

Thus,  we  can  further  categorize  a  homogeneous  region  in  the  physical  domain  by  the  number  of  resolu¬ 
tion  elements  containing  objects  which  contribute  to  a  signature  variation  and  in  th*  statistical  domain  by 
the  number  of  statistically  indeperdent  elements  which  comprise  the  region.  The  "scene  reeolution"  con¬ 
cept  (11)  provides  a  useful  framework  for  analyzing  the  statistical  variation  of  a  region**.  We  shall  define 
this  scene  resolution  as  the  ratio  of  the  average  of  the  nur-.ber  of  sensor  resolution  cells  to  diet  required  to 
make  up  the  equivalent  of  one  independent  element  in  the  imaged  map.  As  discussed  above,  sensor  resolu¬ 
tion  constraints  are  one  contributing  factor  to  "scene  resolution"- -the  other  being  texture. 

Texture,  caused  by  physical  and  electrical  material  variations,  can  exist  even  within  purely  homogeneous 
regions.  The  three  primary  sources  of  homogeneous  material  texture  are:  illuminator-target-detector 
geometry,  which  includes  slope  and  slope  azimuth;  directional  reflectance  and  absorptaice  described  by 
electromagnetic  theory  (Fresnel's  equations)  and  surface  roughness  effects.  Texture  produced  by  these 
processes  can  be  virtually  resolution  independent  in  comparison  to  those  observed  within  a  resolution  depen¬ 
dent  homogeneous  region  (i.  e. ,  see  previous  discussion).  A  more  detailed  presentation  of  homogeneous 
material  texture  '.i  given  In  the  appendix. 

2.  2  Signature  dynamics 

In  order  to  estimate  the  Intensity  magnitude  and  oscillations  that  occur  in  sensor  imagery,  it  is  first 
necessary  to  understand  the  relevant  physical  and  electrical  material  properties  and  governing  atmospheric 
and  meteorological  parameters  present.  A  summary  of  the  governing  material  propertios  for  each  sensor 
region  is  given  in  Table  1.  Similarly,  relevant  atmospheric  and  meteorological  parameters  for  each 
spectral  region  are  given  in  Table  2, 

Contrast  reversals  are  of  importance  to  die  mission  planner  because  of  the  potentially  decorrelatlng 
effect  they  can  have  c.n  map-matching  system  performance.  A  summary  of  the  relevant  parameters  in  each 
spectral  region  that  can  induce  these  effects  is  given  in  Table  3.  The  diurnal  and  seasonal  impact  on 
reference  area  signature  characteristics  is  also  important  since  it  provides  the  mission  planner  with  a 
time-frame  estimate  of  when  region  level  shifts,  hence  contrast  reversals,  are  likely  to  occur.  A  summary 
of  die  time-cycle  impact  on  reference  area  signature  characteristics  for  each  spectral  region  is  given  in 
Table  4. 

The  impact  of  physical  and  electrical  material  properties  and  atmospheric  and  meteorological  effects  on 
time-varying  reference  area  signature  characteristics  will  now  be  presented  for  each  sensor  region.  The 
impact  of  snow /ice /water  on  the  reference  area  signature  will  not  be  considered  here.  An  estimate  of  die 
magnitude  of  contrast  reversals  it  can  induce  within  typical  reference  areas  is  given  in  Section  2.3. 

Passive  ontical/near  IR.  The  governing  miterial  and  atmospheric  properties  in  the  passive  optical/ 
near  IR  interval  (.  4|I  -  1.  6j*)  are  short  wavelength  reflectance,  incident  irradiance,  atmospheric  attenuation, 
and  path  radiance,  respectively.  Contrast  reversals  in  this  spectral  region  are  primarily  due  to  changes  in 
material  reflectance  due  to  seasonal  effects  from  the  vegetation  growth  cycle. 

The  atmospheric  effects,  particularly  attenuation  and  path  radiance,  govern  the  degree  of  observed  con¬ 
trast  for  a  given  imaged  scene.  The  effect  of  atmospheric  attenuation  is  to  uniformly  reduce  die  received 
radiance  across  the  scene.  Path  radiance,  however,  introduces  additive  energy  into  the  imaged  resolution 
element  via  direct  or  indirect  atmospheric  scattering  that  originated  outside  of  it.  The  net  effect  of  these 
two  terms  is  to  lower  the  observed  scene  signal-to-noise  ratio  (SNR)  for  a  given  sensor.  They  are  usually 
the  limiting  operational  factors  in  this  wavelength  region.  Complicating  operational  performance  pre¬ 
dictions  in  this  interval  is  die  fact  that  the  values  of  most  of  the  governing  material  and  atmospheric 
properties  are  generally  a  strong  function  of  v  velength. 

Passive  middle  IP..  The  governing  material  properties  in  die  passive  middle  IR  (3p—5p)  rsgion  are 
middle  IR  reflectance  (hence  emittance)  and  thermal  inertia  (thermal  conductivity  over  the  square  root  of 
thermal  diffusivity).  The  predominant  atmospheric  properties  are  attenuation,  and 

*  Presuming,  of  course,  that  the  signature  of  die  objects  was  different  from  the  grass  at  the  wavelength  of 
.the  sensor. 

**  The  scene  resolution  is  computed  by  determining  die  number  of  independent  (Nj)  elements  in  the  image 
and  then  dividing  this  quantity  into  N,  die  total  number  of  resolution  elements  in  the  scene  (i.  e. ,  N/Nj). 
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TtHi  1.  Gov* min |  Fhyilnl  and  Electrical  Material  Proparti** 
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Table  2.  Atmoepheric  and  Meteorological  Impact  on  Senaed  Imagery 

Type  Parameter  Impact  on  Imaasry* 

P  -  Small  to  atrong  (or  pad)  radiance  and  attenuation 

A  -  Small  to  atrong  for  path  radiance  and  attenuation 

P  -  Small  to  moderate  (or  petit  radiance 

-  Small  to  atrong  (or  attenuation 

•  Small  to  moderate  (or  reradiatton 

-  Small  to  moderate  (or  latent  and  aenelble  heat  traneter 
depending  on  wind  a  peed,  precipitable  water,  and 
atmoapherie  and  ground  temperature*. 

A  -  Small  to  atrong  (or  attenuation 

P  -  Smal'  (or  path  radiance 

-  Small  to  atrong  (or  attenuation  and  reradiation  depending 
on  epeciea,  concentration,  diameter  and  temperature  o( 
aaroaol  diitribution  pitaent. 

•  Small  to  moderate  (or  latent  and  aenaible  heat  trana(er 
depending  on  wind  apeed,  precipitable  water  content  and 
atmoapherie  and  ground  temperature*. 

A  -  Small  to  atrong  (or  attenuation 

P  -  Small  (or  attenuation  unleaa  rain  ia  preaant 

-  Small  to  moderate  (or  oxygen  or  water  (abaorption  and) 
reradlatioa  depending  on  apecie*  concentration  preaant. 

-  Small  to  moderate  (or  latent  and  aenaible  heat  trena(er 
(impact*  molihrt  availability,  henc*  malarial  emittanc* 
and  thermal  energy  balance). 

A  •  Small  (or  attenuation  unleaa  rain  i*  preaant 


*-  Aaaume*  operation  under  cloud  cover  with  no  precipitation 

-  Atmoapherie  attenuation  ia  dependent  on  the  apecie*,  concentration  and  diameter  o(  aaroaol  diatributiona 
preaant  and  atmoapherie  preaaure  (governe  molecular  apeciee  concentration). 
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Table  3.  Source*  of  Image  Contra*:  Reversal* 


Sensor  Reeion 

Jjg«. 

Cause 

Optical/Near  1R 

P  and  A 

-  Optical  /Dear  IR 

Vegetation  Reflectance 

Middle  IR 

P 

-  Material  Thermal  Inertia 

-  Diurnal  3^— —Su  Solar 
Irrad lance  Component 

A 

•  Middle  IR 

Vegetation  Reflectance 

Thermal  IR 

P 

-  Thermal  Inertia 

A 

-  Thermal  IR 

Vegetation  Reflectance 

Microwavr 

P 

-  Atmospheric  ReradUtlon 

-  Thermal  Inertia 

A 

•  Microwave 

Vegetation  Aeflectance 

*  Snow/Ice  /Water  complex  mn  produce  contrast  re  ve  reals  in  each  imaging  region 


Table  4.  Diurnal  and  Seasonal  Environmental  Impact  on  Sensed  Imagery 


Sensor  Reeion  Type  Time  Cycle  Impact  on  Imagery 


Optical /Near  IR 

P 

Diurnal 

•  Small  to  strong  (depends  on  spectral  and 
absolute  level  of  Illumination  Imagery  la 
obtained  under). 

Seasonal 

•  Small  for  spectral  ir radiance  changes 
(sun's  declination  angle)  but  moderate  for 
illumination  level. 

-  Moderate  to  strong  over  vegetation  cycle 

A 

Seasonal 

•  Moderate  to  atrong  over  vegetation  cycle 

Middle  IR 

P 

Diurnal 

Seasonal 

-  Strong:  uhort  and  middle  wavelength 

lr radiance  drives  thermal  Inertia, 
and  direct  reflected  Middin  IR 
component. 

-  Moderate  for  spectral  and  absolute  ir radiance 
level  (hence  thermal  inertia)  differences  from 
sun's  dsclinatlon  angle. 

-  Snail  to  moderate  over  vegetation  cycle 

A 

Seasonal 

-  Small  :o  moderate  over  vegetation  cycle 

Thermal  IR 

P 

Diurnal 

-  Strong:  short  wavelength  irradlance  drives 
thermal  Inertia. 

Seasonal 

-  Same  a*  passive  Middle  IR 

A 

Seasonal 

•  Snail  to  moderate  over  vegetation  cycle 

Microwave 

P 

Diurnal 

-  Small  to  moderate  for  high  microwave  emit- 
taace  objects  (thermal  inertia  can  dominate). 

-  Small  for  low  microwave  amittanca  objects 
(sky  temperature  dominates). 

Seasonal 

-  Small  to  moderate  for  high  microwave  emit  • 
tance  object*  (sun's  declination  angle). 

•  Snail  for  low  microwave  emittanc*  objects 

•  Small  to  moderate  over  vegetation  cycle  de¬ 
pending  on  canopy  and  soil  moisture  content. 

A 

Seasonal 

-  Moderate  over  vegetation  cycle  depending  on 
backscatter  coefficient. 

re  radiation.  The  principal  meteorological  Interaction  paramatara  ara  latent  and  sensible  heat  transfer 
(evaporation  and  convection  reepeetively).  The  material  thermal  inertia  is  related  to  the  net  rate  of  heat 
exchange  at  th*  aurfacc  between  the  air/material  interface.  Thermal  inertia  effects  driven  by  the  abaorbed 
■hort  wavelength  incident  irradiance  during  the  daytime  generally  predominate  the  emitted  power  component 
at  night.  During  the  day.  both  reflected  aolar  middle  IK  and  thermal  inertia  componenta  contribute  to  the 
observed  aignature.  Contraat  revere  ale  in  thia  apectral  region  are  primarily  related  to  material  thermal 
inertia,  where  the  smaller  the  magnitude  of  thia  parametar,  the  greater  the  temperature  (hence  emieaive 
power)  oectllation.  Contraat  revereala  can  aleo  be  induced  In  title  apectral  region  when  a  large  aolar  and 
atmoapheric  3p  —  5ji  flux  la  present,  coupled  with  a  low  to  moderate  material  aurface  temperature.  Here, 
the  time-varying  nature  of  the  downwelling  flux  paaaea  through  a  cycle  of  email  to  large  to  email 
coincident  with  the  aolar  senith  angle.  If  the  3p  —  5p  solar  reflected  component  ia  larger  than  that  due  to 
material  emission,  a  time-varying  contraat  reversal  can  result. 

The  limiting  atmospheric  case  due  to  attenuation  occurs  whan  an  image  la  obtained  through  an  atmosphere 
with  a  moderate  to  large  diameter  aeroaol  distribution.  In  thia  spectral  Interval  atmospheric  attenuation 
from  aerosols  usually  predominates  over  reradiation  from  preclptable  water  during  the  daytime,  but  at 
night  the  reverse  is  possible. 

Sensible  and  latent  heat  transfer  can  impact  the  Imaged  spectral  aignature  in  this  region  >y  altering  the 
ground  temperature.  This  in  turn  impacts  the  image  aignature,  particularly  at  night  when  t\e  ground 
emission  component  predominates. 

El!  sive  thermal  iK.  The  governing  material  properties  in  the  passive  thermal  IK  (8p  —  K'u  )  region  are 
short  wavelength  reflectance  (typically  .  —  1.  6p  ),  thermal  IK  emittance  and  thermal  inertia-  The  princi¬ 

pal  atmospheric  properties  and  meteorological  interaction  parametere  are  identical  to  those  i.i  the  middle 
IR  region. 

In  thia  spectral  region,  material  thermal  inertia  ia  tits  aola  cause  of  observed  ground  aignature  contrast 
reversals.  Since  a  negligible  amount  of  thermal  IK  energy  emitted  by  the  sun  penetrates  the  atmosphere, 
short  wavelength  solar  irradiance  driven,  thermal  inertia  effects  predominate  the  image  over  the  diurnal 
cycle. 

Atmospheric  attenuation  in  a  dry,  cloud-free  atmosphere  is  small  in  this  spectral  region.  A  substantial 
amount  of  reradiation  (hjnee  image  contrast  reduction)  can  occur,  however,  when  a  humid,  warm  atmos¬ 
phere  is  present  due  to  increasing  emissive  power  with  precipitable  water  and  atmoapheric  temperature. 

Such  conditions  will  often  form  the  cloud-free  limiting  case  for  sensor  operation  in  this  spectral  regiou. 

Sensible  and  latent  heat  transfer  becomes  important  when  a  significant  difference  in  atmospheric  and 
ground  temperature  exists, coupled  with  a  non- aero  wind  speed  and  relative  humidity.  These  heat  transfer 
components  can  produce  a  noticeable  signature  oscillation  for  a  reference  area  imaged  under  widely  varying 
meteorological  conditions.  Furthermore,  the  magnitude  of  these  parameters  are  often  difficult  to  evaluate 
due  to  the  lack  of  the  necessary  ground  truth  data. 

Passive  microwave.  The  governing  material  properties  in  the  passive  microwave  imaging  (.3  cm  to  3.0  or) 
region  are  passive  microwave  reflectance  and  thermal  inertia.  The  principal  atmoapheric  parameter  here 
is  the  contribution  of  precipitable  water  to  the  eky  brightness  tsmpsrature.  Sensible  and  latent  heat  trans¬ 
fer  components  tend  to  have  little  impact  on  the  observed  signatures  unless  high  microwave  emittance 
materials  predominate. 


Contrast  reversals  are  only  possible  in  this  spectral  interval  in  two  casas.  The  first  involves  materials 
with  low  microwave  reflectances.  Hers,  tho  material  microwave  emittarce  (times  ground  temperature) 
component  predominates  and  the  resulting  onergy  balance,  hence  imagery,  behavec  similarly  to  that  in  the 
thermal  IR  region.  In  the  second  and  much  rarer  case,  s  reversal  will  occur  whan  the  sky  brightness 
temperature  is  greater  titan  the  material  temperature.  This  is  generally  only  possible  under  cloud  cover 
conditions  when  s  substantial  amount  of  precipitable  water  exists  along  with  a  low  to  mode  rats  ground 
temperature  (-273^  -»-'Z90°K),  Here,  the  emitted  energy  from  the  precipitable  water  becomes  greeter 
titan  that  from  the  reference  material.  As  a  consequence,  materials  with  e  high  microwave  reflectance 
(i.  e. ,  metal  and  water)  can  nave  greater  apparent  brightness  temperatures  than  those  with  a  high  micro- 
wavs  emittance  (i.  e. ,  soil).  This  results  in  a  reversal  over  the  expected  case  where  a  dry  atmoaphere  is 
present. 

Co.it rs^y  to  general  belief,  the  only  materials  that  can  not  exhibit  the  first  type  of  contrast  reversal  dis¬ 
cussed  above  in  the  35  GHs  and  94  GH*  bands  are  metal  and  water,  sines  most  materials  possess  high 
microwave  omittances  in  these  regions  at  small  scan  angles.  As  s  consequence,  regional  error  shifts  (and  in 
some  cases  contrast  reversals)  can  result  sines  many  common  materials  (i.  s.  ,  vegetation,  soil,  concrete 
end  rock)  exhibit  microwave  emittance,  hence  thermal  inertia  dominated  time-varying  oscillations.  Pre¬ 
diction  of  vegetation  and  soil  signature  magnitudes  and  their  oscillationa  can  be  very  difficult,  however, 
because  of  the  impact  of  moisture  availability  on  microwave  material  emittance.  Like  in  the  Infrared 
legions,  additional  instability  in  tits  microwave  signature  can  occur  due  to  atmospheric  reradiation  effects; 
particularly  for  metal  and  water  which  poseess  low  end  moderate  microwave  emittaacss  respectively. 
Passive  microwave  signature  variations  for  these  materials  are  generally  much  larger  than  in  the  infrared 
for  similar  conditions  which  produce  atmospheric  rs radiation. 


Activ*  systems.  For  Imaging  lasers  and  radar*  tha  governing  material  electrical  proparty  la  reftactanc* 
(or  tha  backs  catter  coefficient),  Atmospheric  abaorptloa  and  aeattartng  (attanuatlon)  la  often  tha  limiting 
environmental  factor  for  laaar  Imaging  systems,  al though  It  la  uaually  email  for  radara.  Thaaa  systems 
are  at  least  directly  insensitive  to  many  of  the  complex  time-varying  phyaical  atmoapharic  and  meteorologi¬ 
cal  affect*  that  Impact  paaaiva  eyatama  (i.  a. ,  thermal  Inertia,  aolar  irradtance,  and  latent  and  asneible 
haat  tranafar). 

An  additional  claaa  of  active  aanaora  exiated  that  uaa  the  apactral  tranamlttad  beam  to  a  phaee  modulated 
carrier  or  range-gated  form.  The  advantage  of  thaaa  aanaora  la  that  they  can  be  relatively  tnaenattlv*  to 
all  material  and  meteorological  properties  and  generally  are  only  limited  by  atmoapharic  affect*.  In  tha 
first  case  a  frequency  modulated  signal  la  placed  on  an  optical  laser  carrier  beam.  Very  accurate  target 
ranging  and  depth  Information  Is  possible  by  detecting  the  phase  front  distortions  of  the  returned  beam 
induced  by  the  object. 

The  second  type  of  system  is  operated  in  a  ranging  form  by  measuring  the  two-way  propagation  time  to 
the  ground  or  target  (down  and  forward-looking  respectively).  A  common  down-looking  form  of  this  system 
is  a  radar  altimeter  cued  in  Terrain  Contour  Matching  (TERCOMJ.  A  widely  used  forward-looking  form  Is 
the  laser  rangefinder  used  In  tactical  armored  vehicles. 

For  both  types  of  systems  two  governing  performance  factors  exist.  First,  the  reflected  object  energy 
must  be  high  enough  to  produce  an  acceptable  SNR.  This  often  limits  the  operational  distance  because  of 
beam  dispersion,  and  atmospheric  effects  (lasers  only).  The  second  iuvolvee  the  beam  pattern  Itself.  If 
it  1*  too  large  In  diameter  versus  the  imaged  object,  phase  information  becomea  ambiguous  for  the  first  type 
of  system.  For  die  altimeter  or  rangefinder  ayatem  this  also  poses  a  problem  due  to  an  Increasing 
uncertainty  in  knowing  the  object  that  produced  the  first  or  strongest  return.  Their  principal  disadvantages 
include  hardware  complexity  and  lack  of  maturity  (phasf  modulated  laser)  and  potential  inaccuracy 
(altimeters  and  rangefinders)  against  point  targets  due  to  reference  imaging  requirements  and  their  usual 
one-dimensionel  configuration.  When  targeting  conditions  permit  and  operation  essentially  invariant  to 
environmental  conditions  le  necessary,  these  two  types  of  sensor  systems  should  be  strongly  coneidered. 

Atmospheric  and  meteoroloelcal  parameters.  A  summary  of  die  relevant  atmospheric  and  metaorologl- 
cal  parameters  on  sensed  terrain  Imagery  is  given  in  Table  2.  Ker%  molecular  absorption  has  not  been 
dlrecdy  considered.  It  ie  at  least  implied,  however,  since  the  atmospheric  windows  utilised  for  remote 
sensing  exist  in  regions  where  dies*  effects  are  small.  Molecular  absorption  band  characteristics  vary  with 
temperature  and  pressure  for  a  given  species.  Aerosol  absorption  and  scattering  are  leea  specific,  since 
they  also  vary  with  the  diameter  distribution  present. 

F rom  Table  2  it  is  apparont  that  path  radiance  effect*  caused  by  aerosol  water  decrease  noticeably 
beyond  die  optical/near  and  middla  lR  regions.  This  is  a  result  of  the  aeroeol  diameter  distribution*  typi¬ 
cally  present  and  the  small  amount  of  aolar  irradiancs  that  axists  in  tha  thermal  1R  and  passive  microwave 
regions.  Reradiatlon  becomes  increasingly  important  with  wavelength,  and  in  passive  microwave  imagery  it 
is  the  dominant  rain-free  relevant  atmospheric  parameter.  Latent  and  sensible  heat  transfer  *  re  the  pre¬ 
dominant  meteorological  remote  sensing  parameters.,  and  can  have  a  moderate  impact  on  the  resulting 
energy  balance  present  in  middle  and  thermal  IR  imaging  and  alter  the  resulting  emlttances  of  soma  passivs 
microwave  materials  (particularly  soil). 

Time-cvcle  impact.  Large  oscillations  possibly  contrast  reversals  in  material  signatures  often  occur 
during  diurnal  and  seasonal  time-frames.  A  summary  of  the  relevant  phenomana  for  activ*  and  passive 
aeneor  systems  is  given  in  Table  4.  Two  factors  are  evident  from  the  data  given.  First,  the  performance 
of  each  passive  ssnsor  system  can  be  altered  by  die  level  and  apectral  distribution  of  incident  soler  irradi- 
ance  in  tha  atmosphere  and  at  the  ground  plane.  Second,  the  spectral  reflactance,  thermal  inertia,  and 
moisture  availability  associated  with  vegetation  growth  cycles  on  land  can  significantly  impact  imaged  signa¬ 
ture*  in  every  spectral  band  on  a  seasonal  basis.  Only  phase -modulated  or  range-gated  lasers  and  radars 
appear  to  be  relatively  immune  to  this  problem  as  long  aa  deciduous  tress  are  absent. 

Two  items  have  been  omitted  irom  Table  4  for  simplicity.  The  magnitude  and  type  of  atmoephsrlc  end 
meteorological  effects  present  prior  to  and  at  the  moment  of  imaging  are  represented  by  a  joint  diurnal- 
seasonal  time  cycle  probability  distribution  function.  Likewise,  the  presence  of  enow/iee/water  within  the 
reference  area  can  aleo  be  described  by  another  joint  diurnal-seasonal  probability  distribution  function. 
These  two  distributions  are  very  complex  (perhaps  presently  indeterminate)  and  only  moderately  correlated 
with  time.  Consequently,  at  best  it  is  only  possible  to  approximate  die  impact  of  these  factors  on  spectral, 
time-varying  reference  area  signature*. 

2.  3  Man  difference  errors 

From  a  systems  point  of  view  one  can  categorise  all  the  map  dlfferencss  aa  affecting: 

1.  the  spatial  shape  of  homogeneous  regions, 

2.  the  relative  mean  intensity  levels  between  homogeneous  regions,  and 

3.  the  absolute  intensity  level  of  a  region. 


In  the  vernacular  these  effects  ara  commonly  rafarrad  to  aa  nonttructured  error*,  eor'rart  reversals, 
and  predictive  coding  error*,  raapactivaly,  A  combination  of  these  factor*  are  generally  present  in  eanaor 
image i y  and  induce  error*  in  the  map-matching  process  due  to  thnir  complex  nature, 

Nonstructured  error*  can  be  broken  down  into  two  categories.  In  the  fir*t  c**e,  the  impact  of  the  pertur¬ 
bation*  i*  predictable,  although  it  may  not  be  possible  or  desirable  to  prepare  a  large  number  of  reference 
scenet  for  compensation.  Errors  in  this  clast  include  shadow* ,  which  can  lead  to  contrast  reversals 
within  the  affected  region.  Their  location  can  be  calculated  given  the  illumlnntor-targct-vehicle  geometry 
combined  with  the  terrain  topography.  Errors  of  the  second  type  are  more  difficult  to  predict,  hence  to 
produce  compensating  images.  These  errors  include  terrain  area*  obacured  by  clouds  and  snow  fice/waier. 
Here,  the  joint  probability  space-time  error  distribution  affecting  the  reference  area  (hence  each  reolution 
element)  la  virtually  unknown. 

The  net  effect  of  changes  in  the  atmospheric,  meteorological  and  physical  and  electrical  material  pro¬ 
perties  is  to  produce  variations  in  the  intensity  level  of  one  homogeneous  region  relative  to  another.  If  the 
intensity  level  shifts  are  severe,  contrast  reversals  between  regions  can  result.  An  estimate  of  the 
expected  range  of  contrast  ratio  reversals  between  representative  natural  materials  is  given  in  Table  5. 
Maximum  values  and  the  governing  parameter  are  given  in  two  caees  for  each  spectral  region.  In  the  first 
case,  contrast  reversal  ranges  due  to  physical  atmospheric  and  meteorological  parameters  are  given.  Ir. 
the  second  case,  those  produced  by  snow /ice/water  are  presented. 


Strictly  speaking,  signature  variations  caused  by  snow/ice/water  are  predictive  errors.  The  effect  of 
this  complex  is  to  produce  random  apace  and  time-varying  signature  boundaries,  hence  artifical  homo¬ 
geneous  regions,  within  tho  reference  area.  As  a  result,  contrast  reversals  can  occur  within  the  sensor 
image  due  to  signature  variations  between  homogeneous  regions  created  by  the  snow /ice /water  and  tnose 
from  the  nominal,  underlying  material  signature.  Preprocessing  techniques  that  emphasise  homogeneous 
regions  in  the  sensor  scene  can  produce  catastrophic  map-matching  failures  when  snow /ice /water  are  likely 
to  exist. 
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For  the  passive  optical  near  1R  and  all  active  caeea,  the  output  it  given  in  db  change  in  material 
reflectance.  For  the  passive  middle  and  thermal  IR,  and  microwave  caioe,  result*  are  presented  in  both 
watts  /cm2 -steradian  and  db  of  radiance  change  between  regions.  Results  are  similarly  given  in  the  snow/ 
ice/water  cases  except  the  signature  of  the  perturbing  state  is  compared  directly  to  a  nominal  material. 
Results  for  the  passive  middle  and  thermal  U<,  and  microwave  cases  were  determined  with  the  aid  of  a 
sophisticated  atmospheric  boundary  layer  model.  Contrast  reversal  ranges  were  not  computed  for  man¬ 
made  materials  because  of  the  complexities  Introduced  by  geometry  and  internal  heating  (for  the  middle  and 
thermal  IR  cases). 

Contrast  reversals  produced  by  means  other  than  snow /ice /water  will  first  be  examined.  From  Table  5, 
it  i»  clear  that  the  vegetation  cycle  can  produced  significant  contrast  reversals  against  soil  (as  well  as  other 
material)  backgrounds  for  active  and  pasaive  optical/near  IR  and  active  middle  and  thermal  IR  imaging 
systems.  The  largest  reversals  in  the  passive  middle  and  thermal  IR  caeea,  however,  are  generally  pro¬ 
duced  by  solar  ir radiance  driven  thermal  Inertia  differences  between  materials  present.  Contrast  reversals 
can  also  occur  in  the  passive  microwave  region  due  to  the  vegetation  cycle,  where  the  primary  contributing 
factors  are  soil  and  plant  moisture  availability.  Reversals  or  intensity  shifts  between  homogenous  material 
regions  are  primarily  produced  in  this  spectral  interval  by  moiature  availability  and  thermal  inertia  effects 
which  impact  the  microwave  emittance  and  ground  temperature (hance  die  emissive  power  ground  component) 
dependirg  on  the  climatic  conditions  present. 

When  contrast  reversals  due  to  predictive  errors  from  enow /ice /water  are  examined,  it  it  clear  that  the 
magnitudes  produced  by  this  cause  are  greater  than  those  from  the  corresponding  non-snow /ice-water  (vege¬ 
tation  cycle  and  thermal  inertia)  cases  in  every  instance.  Although  these  values  may  serve  ae  reasonable 
upper  bounds,  the  mission  planner  should  be  aware  that  changes  in  the  snow  /ire/water  state  can  produce 
substantial  signature  vairations  over  a  short  to  long  time -frame  due  to  the  complicated  physical  and 
electrical  properties  of  this  material  complex. 

From  this,  it  is  clear  that  no  imaging  spectral  region  is  immune  from  contrast  reversal  effects.  It  is 
possible,  however,  to  reduce  their  magnitude,  or  in  some  cases  eliminate  them  entirely  if  careful  nominal 
signature  prediction  is  utilised  together  with  criteria  for  eliminating  regions  where  large  signature  oscilla¬ 
tions  will  surely  exist.  A  more  detailed  discussion  of  this  problem  is  given  in  Section  3.  3. 

Ae  indicated  in  Figure  3,  a  reference  generation  process  is  used  to  develop  an  Image  for  map-matching 
purposes.  Obviously,  to  ensure  systems  performance  foie  processing  atop  must  have  the  highest  degree  of 
accuracy  possible.  Two  type*  of  predictive  errors  can  arive  from  less  than  a  perfect  process.  The  first  is 
the  result  of  having  to  synthetically  create  imagery  In  a  given  spectral  region  when  source  data  are  unavail¬ 
able.  The  second  involves  utilising  real  or  synthetic  reference  imagery  selected  or  generated  with  one  set 
of  environmental  parameters  but  used  against  another  where  a  significant  signature  divergence  has  occurred 
The  mission  planner  should  use  a  nominal  rather  than  abnormal  reference  image  when  large  signature  per¬ 
turbations  are  possible  which  can  not  be  accurately  predicted. 

When  spectral  band  conversion  is  necessary  the  materials  within  the  reference  area  must  first  be  identi¬ 
fied.  The  synthetic  image  signature  is  generated  by  using  foe  known  physical  and  electrical  properties  of 
the  Identified  materials  in  conjunction  with  the  specified  Uluminator-target-detector  geometry. 

A  compilation  of  factors  influencing  foe  accuracy  of  reference  image  prediction  versus  the  actual  scene 
signature  is  presented  in  Table  6.  An  estimate  was  made  of  foe  expected  prediction  errors  for  homogeneous 
regions  within  representative  reference  areas  for  each  spectral  region  and  is  given  in  Table  7.  Reasonable 
uncertainty  values  of  perturbation  components  given  in  Tables  2,  4,  and  6  were  used  tc  generate  these  esti¬ 
mated  regional  errors.  Although  these  values  should  only  be  used  as  a  guide,  they  can  provide  the  mission 
planner  with  an  estimate  of  which  map-matching  algorithms  can  not  be  used  with  certain  forms  of  spectral 
imagery.  This  is  due  to  foe  performance  breakdown  of  some  algorithm  classes  with  increased  regional 
errors.  The  estimated  regional  errors  in  Table  7  include  contributions  from  material  identification  where 
appropriate. 

Result*  given  in  Table  7  were  calculated  using  diurnal,  seasonal,  and  yearly  time-varying  signature  esti¬ 
mations  for  a  hypothetical  reference  area  composed  of  45  peicent  vegetation,  30  percent  soil,  20  percent 
concrete,  and  5  percent  rock.  Snow/ice/water  complex  materials  were  excluded  from  this  analysis. 
Vegetation  possesses  the  only  time-varying  dielectric  signature  variation  (excluding  snow/ice/water)  in  foe 
optical/uear  IR  region.  As  a  consequence  foe  error  bounds  given  in  Table  7  for  active  and  pasaive  types  in 
this  interval  should  be  evaluated  accordingly  when  other  vegetation  proportions  are  present.  Although  not  a 
factor  for  an  active  system,  large  actual  versus  predicted  error  bound*.  for  passive  optical/near  IR  systems 
can  exist  if  diurnal  operation  is  desired  due  to  significant  spectral  irradiance  variations  present  in  day 
veraua  ambient  night  light. 

As  in  foe  optical/near  IR  case,  foe  primary  source  of  estimated  versus  actual  regional  error  bound*  in 
active  middle  and  thermal  IR,  and  microwave  images  is  due  to  the  time-varying  vegetation  signature  pre¬ 
sent.  In  these  Intervals,  however,  foe  general  lack  of  source  data  necessitates  using  a  material 
identification  step  in  producing  synthetic  reference  imagery.  The  resulting  errors  in  this  procedure  coupled 
with  the  lack  of  a  complete  physical  and  electrical  material  properties  catalog  produce  errors  in  foe  signa¬ 
ture  translation  process. 
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Table  0.  Parameter  Error  Impact  on  Intenaity  Eatlmat*  Accuracy 
(Decreasing  Order  of  Importance) 


Ixs* 

Passive 

Active 

Cptical/Near  IR 

Imaging  weather 
slope  /slope  aslmuth 

seasonal 

moisture  availability 
surface  variations 
dlu  rnal 

reflectance  knowledge 

Imaging  weathe  r 
slope /slope  asimuth 

seasonal 

surface  variations 
moisture  availability 
reflectance  knowledge 

Middle  IR 

Imaging  weather 
thermal  inertia 
diurnal 

pre  -imaging  weather 
slope /slope  asimuth 
moisture  availability 

seasonal 

subsurface  variations 
moisture  availability 
albedo  knowledge 
surface  variations 
emittance  knowledge 

Imaging  weather 
slope /slope  asimuth 
surface  variations 

seasonal 

reflective  knowledge 
moisture  availability 

Thermal  IR 

Imaging  weather 
thermal  inertia 
moisture  availability 
slope /slope  asimuth 
pre -imaging  weather 
seasonal 

subsurface  variations 
albedo  knowledge 
surface  variations 
diurnal 

emittance  knowledge 

Imaging  weather 
slope /slope  asimuth 
surface  variations 
seasonal 

moisture  availability 
reflective  knowledge 

Microwave 

Moisture  availability 
thermal  inertia 
imaging  weather 
surface  variations 
emittance  knowledge 

Slope /slope  asimuth 
surface  variations 
seasonal 

moisture  availability 
reflectance  knowledge 

In  the  paasive  middle  and  thermal  DR  cases,  the  primary  source  of  estimated  versus  actual  regional 
error  bounds  is  due  to  the  ground  emission  component  governed  by  the  thermal  inertia  of  the  materials  pre¬ 
sent.  In  addition  to  the  large  regional  error  present  between  moat  day /night  pairs  analysed  in  these  cases 
is  the  fact  that  a  high  degree  of  anticorrelation,  indicative  of  the  inherent  contrast  reversals,  also  existed. 
These  effects  are  generally  noted  when  materials  with  a  moderate  to  high  range  of  thermal  inertias  are 
present  within  a  reference  area.  As  in  the  active  cases  previously  mentioned,  material  identification  errors 
and  data  gaps  in  material  property  libraries  also  contribute  to  the  regional  errors  present. 

As  previously  discussed  in  this  section,  when  materials  with  high  microwave  emittances  are  present 
within  a  reference  area,  the  resulting  time-varying  passive  microwave  signature  can  behave  similarly  to 
that  in  the  middle  and  thermal  IK  regie  '.  If  materials  with  moderate  to  low  microwave  emittances  are  pre¬ 
sent,  the  variation  in  die  ground  temperature  component  of  the  apparent  brightness  temperature  due  to 
material  thermal  inertia  effects  is  damped,  and  a  greater  degree  of  regional  error  stability  results. 

In  the  case  of  range  or  phase-modulated  sensors,  die  principal  source  of  predicted  versus  actual  regional 
errors  is  due  to  the  time-varying  nature  of  vegetation  signatures  (particularly  deciduous  trees)  present 
within  the  reference  area.  A  high  degree  of  reference  stability  is  possible  with  these  sensor  types  if  care¬ 
ful  reference  scene  screening  is  utilised. 
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Table  7  Estimated  Venui  Actual  Regional  Error  Bound'. 


** 

Expected  Error  Bourdg 

Spectral  Interval 

Type 

Low 

High 

Optical/Near  IR 

P 

15% 

25% 

A 

10% 

20% 

Middle  IR 

P 

20% 

>  100% 

A 

15% 

30% 

Thermal  IR 

P 

15% 

>  100% 

A 

10% 

30% 

Microwave 

P 

15% 

>100%*** 

A 

20% 

35% 

Range  or  Phase- 

A 

Small  except  when  deciduous  trees  present 

Mrdulated  Sensors 

*  Exclusive  cf  ?>tw/ice /water  complex 


■>'*  The  average  till  ferenct  between  the  actual  mean  intensity 
level  difference  among  regions  and  the  predicted  intensity 
level  difference  among  regions  divided  by  the  actual 
intensity  range  period  spread  among  regions. 

When  vegetation  fraction  is  replaced  by  metal,  error 
bound  range  is  15%  to  30%. 


2, 1  Remedies 

Cor.-  reversals,  nonsti uctured,  and  ^rr.V'jtive  errors  can  cause  map-m  tching  performance  degrada- 
tiom  r  -  1  an  other  !>""or  types  (i.  e. ,  geomet  distortions)  are  minimal.  There  are,  however,  four 
differ-  ,n  r.  -rouy  cat.-,  ■'*  mat  can  minimize  the  impact  o t  these  errors  on  map-matching  systems 
performance.  They  i.dude:  (1)  accurate  nominal  signature  prediction,  (2)  proper  scene  selection, 

(J)  algorithm  flexibility,  and  (4)  adaptive  performance  prediction. 

Accurate  nominal  signature  prediction  is  desirable  to  reduce  level  shifts,  hence  minimize  contrast 
reversals  between  homogeneous  regionc  within  the  reference  area.  Errors  present  in  the  signature  model, 
choice  of  nominal  atmospheric  conditions  or  material  identification  process  (if  utilized)  will  all  contribute 
to  reduced  map-matching  performance.  Although  preprocessing  the  reference  and/or  sensor  scenes  can 
potentially  reduce  the  impact  of  global  and  local  bias  and  gain  changes,  the  results  are  quite  sensitive  to 
cccurately  predicting  the  correct  time-varying  spatial  and  intensity  structure  of  the  image.  If  applied 
improperly,  preprocessing  steps  can  actually  reduce  rather  than  increase  systems  performance.  An  addi¬ 
tional  discussion  of  these  factors  is  given  in  Section  3. 

Proper  scene  selection  is  important  for  two  major  reasons.  Areas  that  are  prone  to  have  large  signature 
variations  in  a  given  spectral  region  due  to  contrast  reversals,  nonstructured  or  prediction  errors  should  v  e 
identified  and  eliminated  if  possible  in  the  scene  selection  process.  As  a  consequence,  an  accurate 
reference  scene  screening  procedure  is  desirable  so  that  an  estimate  of  the  probability  of  false  fix  (Pff)  can 
he  determined  under  a  variety  of  environmental  conditions  for  a  given  area.  It  is  necessary  here  to  evaluate 
-jie  area  for  intrascene  redundancy  under  an  expected  operational  SNR.  If  an  unacceptably  high  Pff  results, 
'.he  candidate  reference  image  should  be  rejected.  A  more  detailed  presentation  of  these  topics  is  also 
given  in  Section  3, 

It  is  desirable  to  utilize  ,&p-matehing  algorithms  that  offer  a  degree  of  insensitivity  to  environmental 
perturbation^',  geometric  distortions  and  SNR  while. accurately  locating  the  true  mate’:  point.  Each 
algorithm  da  •*  'correlation,  faature  extraction,  and  hybrid)  ha*  its  own  advantages  and  disadvantages 
depending  on  the  type  of  imagery  processed  and  the  magnitude  of  the  distortions  present.  A  more  detailed 
discussion  of  this  topic  is  given  in  Section  4. 

Since  map-matching  algorithm  performance  begins  to  break  down  with  increasing  distortion  present 
in  sensor  imagery,  it  is  desirable  to  utilize  a  technique  that  provides  a  confidence  estimate  of  the  quality  of 
the  fix.  A  generally  used  method  is  to  examine  the  surface  statistics  produced  by  the  map-match)  .g 
algorithm  correlation  of  reference  and  sensor  scenes.  Utilizing  a  simple  technique,  however,  that  does  not 
compensate  for  the  original  scene  properties  or  the  impact  of  the  algorithm  itself  on  the  resulting  surface 
distribution  can  be  inaccurate  when  typical  distortions  are  present.  A  more  detailed  discussion  of  adaptive 
performance  predictions  Is  given  in  Section  5.2. 
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3.  Reference  map  construction  and  ecene  selection  process 

Figure  4  describes  the  overall  map  construction  and  scene  selection  process.  Several  steps  are 
necessary  to  develop  a  reference  map  from  raw  sensor  data.  In  the  first  step  of  the  process,  it  may  be 
necessary  to  identify  the  scene  material  (especially  if  a  different  wavelength  is  to  be  utilised)  and  geometri¬ 
cally  correct  for  other  viewing  aspects.  Once  this  is  accomplished  the  scene  signature  can  be  predicted  and 
a  nominal  signature  determined.  Due  to  environmental  factors  and  other  time -varying  variations  Inherent  in 
the  properties  of  scene,  it  is  also  necessary  to  predict  perturbations  to  the  nominal  that  are  likely  to  occur. 
Having  completed  the  signature  prediction  task  it  is  necessary  to  construct  th«  reference  map  and  check  via 
the  scene  selection  process  that  it  is  adequate  for  the  map-matching  task.  In  constructing  the  reference  map 
in  many  cases  it  is  necessary  not  only  to  predict  intensity  levels  but  (depending  on  the  matching  algorithm) 
also  to  identify  homogeneous  regions  within  the  scene.  Once  this  is  accomplished  the  scene  can  be  checked 
via  mathematical  techniques  to  ensure  that  it  contains  sufficient  information  for  matching  purposes  and  that 
the  scene  is  sufficiently  unique  to  avoid  any  major  inter-scene  redundancy  problems.  Finally,  the  reference 
scene  must  be  tested  via  simulation  to  ensure  that  it  is  suitable  under  real  world  conditions. 

This  section  will  briefly  examine: 

1)  the  conversion  process, 

2)  the  problems  associated  with  signature  prediction, 

3)  construction  of  the  reference  map,  and 

4)  the  scene  selection  process. 


Conversion  Signature  Reference  Map  Scene 

Process  Prediction  Construction  Selection 


Figure  4.  Reference  map  construction  and  scene  selection  process 


3.  1  Conversion  process 


As  di  cussed  previously  the  first  phase  of  reference  map  construction  generally  involves  conversion  of 
the  raw  sensor  data:  1)  to  the  wavelength  or  frequency  of  the  sensor  onboard  the  vehicle  and  2)  to  the  geo¬ 
metrical  perspective  from  which  the  sensor  is  to  view  the  scene.  Because  the  raw  data  is  generally  not  at 
the  same  wavelength  as  the  sensor  it  is  necessary  to  estimate  the  material  properties  of  each  region  of  the 
scene.  Since  many  materials  have  very  similar  broad  band  reflectance  properties  in  the  optical/near  IR  por 
tion  of  the  spectrum  (from  which  most  raw  imagery  originates)  there  may  be  significant  mis -identification 
errors  which  can  create  map-matching  difference  errors  and  ultimately  degrade  total  system  performance. 

The  other  major  almost  insurmountable  problem  is  to  adjust  the  imagery  for  the  geometry  perspective 
which  the  sensor  is  likely  to  see.  For  systems  which  look  directly  down  (down-looking  systems)  the 
geometry  corrections  are  quite  simple  since  one  can  assume  a  flat  plane  model  for  the  ground.  For  other 
non-down  looking  systems  the  geometric  conversion  process  involves  developing  3-D  target  model  from  the 
original  2-D  imagery  and  then  creating  a  2-D  image  at  the  anticipated  perspective  angle.  Since  the  vehicle 
may  not  actually  fly  the  nominal  trajectory,  non  down-looking  systems  are  subject  to  geometric  errors 
which  require  significant  processing  efforts  to  remove. 


mature  prediction 


Signatures  of  the  reference  map  need  to  be  determined  not  only  for  the  final  reference  map(s)  which  are 
stored  in  the  vehicle  for  comparison  but  also  to  test  (via  simulation)  the  performance  of  the  system. 
Seasonal  mapu  of  ive  reference  area  may  need  to  be  developed  and  stored  for  use  in  at  least  some  map¬ 
matching  systems.  Depending  on  sensor  wavelength  and  map-matching  algorithm  it  may  also  be  necessary 
to  store  separate  reference  maps  which  account  for  diurnal,  atmospheric  and  meteorological  effects  on  the 
reference  scene  image.  The  mission  planner,  or  reference  scene  evaluator  is  cautioned  not  to  develop 
overly  sophisticated  signature  models  whan  an  underspecified  set  of  conditions  will  exist.  Even  worse  is 
the  case  where  poor  guesses  are  made  for  certain  input  variable  magnitudea;  since  in  some  cases  this  will 
result  in  nominal  reference  signature  with  greater  error  titan  that  from  a  simple  model. 


-14- 


Perturbed  signature  variation*  from  the  nominal  ara  required  to  teat  the  performance  of  the  eyatem 
under  a  variety  of  diurnal,  seasonal,  atmospheric,  and  meteorological  condition*.  One  should  utilise  this 
procedure  to  determine  whether  several  reference  maps  will  perform  better  under  a  variety  of  signature 
conditions  than  *  nominal  signature  prediction  which  is  not  accurate  for  any  one  scene  condition  but  ia 
designated  for  compensating  for  these  variational  effects. 

3. 3  Reference  man  construction 

In  the  reference  map  construction  area  there  a.-o  two  questions  which  need  to  be  addressed.  First,  what 
characteristics  should  the  reference  scene  possess  ?  Second,  how  should  the  reference  scene  be  evaluated? 

In  this  subsection  we  shall  briefly  discuss  the  choice  oi  a  reference  area.  In  the  subsequent  section  we  shall 
discuss  die  simpler  question  of  reference  scene  evaluation. 

Table  S  lists  some  of  the  characteristics  in  the  ideal  reference  map  case  versus  the  real  world  situation. 
If  the  ideal  reference  map  characteristics  shown  in  this  table  existed  then  no  reference  screening  or  evalu¬ 
ation  procedure  would  be  necessary.  Philosophically,  one  can  not  control  mother  nature  nor  can  one  obtain 
agreement  (even  .f  one  could  control  mother  nature)  on  what  scene  characteristics  (number  of  homogeneous 
regions,  interpixel  correlation  length,  etc.)  are  best  for  map-matching  systems.  The  only  sure  thing  that 
can  be  said  about  reference  map  construction  is  that  certain  signature  characteristics  should  be  avoided,  and 
hence  this  is  the  major  topic  of  the  following  discussion.  Since  many  types  of  algorithmic  require  that  homo¬ 
geneous  regions  or  features  be  identified  in  the  reference  map  a  brief  discussion  of  automatic  techniques  for 
the  region  extraction  is  included  here. 


Probable  Reference  Scene  Characteristics 
Probable  Case 


Table  8.  Ideal  Versus 

Ideal  Case 

Error  free  source  data  base 


No  reference  map  preparation  errors 


Reference  scene  contains 

-  A  single  homogeneous  region 

-  No  intra- scene  redundancy 

-  Statistically  independent  scene  elements 

-  Simple  statistical  intensity  distribution 

-  Time  and  space  invariant  signature 

without  contrast  reversals. 


Source  data  base  has: 

-  Finite  SNR 

-  Environmental  and  geometric  distortions 

present. 

Datum  plane  transferral  errors 
Imperfect  material  identification  and  signature 
model*  used  in  spectral  translation. 

Reference  scene  usually  contains: 

-  Several  homogeneous  regions 

-  At  least  some  intra- scene  redundancy 

-  Interpoint  scene  element  correlation 

-  Complex  statistical  intensity  distribution 

-  Time  and  space -varying  signature  with 

contrast  reversals. 


Proper  scene  selection.  Because  of  the  complexity  possessed  by  most  spectral  imagery  and  its  non¬ 
linear  space  and  time-varying  signature  characteristics,  the  reference  scene  selection  process  is  less  than 
an  exact  science.  It  is  generally  easier  to  make  qualitative  assessments  as  to  desirable  or  undesirable 
signature  physics  traits.  It  is  considerably  more  difficult,  however,  to  determine  exactly  how  good  a  candi¬ 
date  reference  area  is  without  rigorous  evaluation  due  to  fhe  statistical  nature  of  expected  environmental  and 
geometric  distortions,  SNR  effects  and  intrascene  redundancy. 

The  net  effect  of  these  degradations  is  to  impact  map-matching  algorithm  performance,  and  hence,  the 
reliability  of  the  fixing  process  itself.  An  examination  of  algorithm  class  sensitivity  to  SNR  and  contrast 
reversals  is  given  in  Section  4,  3,  while  a  review  of  fix  performance  estimation  measures  is  presented  in 
Section  5. 2, 

If  a  map-matching  algorithm  is  utilised  which  is  sensitive  to  contrast  reversals  (i,  e. ,  ordinary  correla¬ 
tion  metrics)  then  vegetation  that  exhibits  strong  time-varying  growth  variations  should  be  omitted  or 
minimised  in  update  areas  in  every  spectral  Interval.  Similarly,  it  is  also  advisable  tc  eliminate  candidate 
update  areas  where  low  material  'thermal  Inertia  and  short  wavelength  reflectance  in  the  passive  middle  and 
thermal  1R,  and  microwave  (for  high  microwave  emittance  materials)  regions  predominates  to  avoid  contrast 
reversal  effects.  From  Table  5,  It  ie  clear  that  the  snow /ice /water  complex  can  adversely  alter  die 
reference  area  signature  in  each  spectral  interval.  Obviously  then,  water  bodies  should  only  be  included  in 


-15- 


reference  area*  if  they  are  unlikely  to  freeze  because  of  the  moderate  to  large  signature  perturba  tions  that 
can  result  in  active  and  passive  spectral  imagery.  Unless  phase-modulated  or  range-gated  systems  are 
utilised,  disastrous  fixing  results  will  often  occur  with  ordinary  correlation  or  feature  matching  algorithms 
when  snow /ice/water  is  present  and  changes  in  complex  state  an  expected. 

If  map-matching  algo  rithms  are  used  which  are  sensitive  to  SNR  (primarily  feature  matching  and  to  a 
lesser  degree  the  hybrid  processing  approach),  then  regions whe re  strong  atmospheric  and  meteorological 
variations  exist  should  be  carefully  evaluated.  The  impact  of  atmospheric  parameters  (particularly 
attenuation  and  aerosol  scattering)  typically  decreases  with  increasing  wavelength,  but  still  generally  forms 
the  limiting  operational  case  to  the  thermal  IR  region  (where  reradiation  becomes  important).  In  the 
passive  microwave  region,  reradiation  from  percipitablt  water  can  introduce  small  to  large  signature  vari¬ 
ations;  particularly  when  materials  of  differing  microwave  omittances  exist.  Radars,  however,  are 
generally  unaffected  by  all  but  the  modt  severe  atmot  pher'.c  conditions. 

Although  meteorological  effects  (i.  e. ,  latent  and  sensible  heat  transfer)  typically  produce  a  smaller  per¬ 
formance  degradation  than  atmospheric  ones,  they  directly  impact  the  terrain  signature  in  each  spectral 
region  when  soil  moisture  is  present  by  governing  its  rate  of  evaporation.  For  each  active  spectral  region 
and  passive  optical  /near  IR,  this  appears  as  a  change  in  soil  reflectance.  In  the  passive  middle  and  thermal 
IR,  and  microwave  regious  soil  moisture  variations  alter  the  emissive  powers  of  the  surface. 

Soil  moisture  effects  will  generally  impact  or  binary  correlation  and  feature  matching  algorithm  per¬ 
formance  the  greatest,  since  its  presence  in  sensor  imagery  is  space  and  time-varying  and  is  often  not 
equally  proportioned  within  a  homogeneous  region.  The  impact  of  latent  and  sensible  heat  transfer  for  low 
soil  moisture  and  high  atmospheric  precipitable  water  will  generally  be  to  reduce  the  dynamic  range,  hence 
contrast  between  homogeneous  regions,  in  passive  middle  and  thermal  IR,  and  microwave  imagery. 

In  some  cases  even  these  procedures  vill  be  inadequate  to  produce  representative  imagery  for  guidance 
updating  purposes.  Here,  it  may  be  necessary  to  select  multiple  reference  Images  of  the  same  area  to 
compensate  for  diurnal  and  seasonal  effects.  From  this,  the  mission  planner  can  either  select  the  most 
representative  image  in  near  real-time  or  store  the  set  of  multiple  frames  in  the  vehicle. 

Diurnal  variations  in  passive  middle  and  thermal  IR,  and  microwave  imagery  tend  to  be  region-based. 
Seasonal  variations  except  those  induced  by  snow /ice/water  tend  to  be  lnterregion.il  for  all  the  candidate 
sensor  types  considered  here.  As  a  consequence,  the  hybrid  map- matching  algorithm  is  often  desirable  if 
an  adequate  SNR  exists.  From  this,  it  is  apparent  that  proper  algorithm  selection  for  a  given  sensor  type 
can  often  simplify  the  task  of  nominal  reference  scene  prediction.  Conversely,  r.slng  a  sub-optimal 
algorithm  will  often  place  an  overly  stringent  accuracy  requirement  on  signature  prediction,  and  signifi¬ 
cantly  increase  the  time  required  for  reference  scene  preparation. 

Preprocessing  references  and  sensor  images  or  using  binary  data  correlation  can  reduce  the  impact  of 
signature  perturbation  factors.  As  previously  discussed,  such  schemes  can  n-t  bo  successfully  utilized 
without  a  thorough  understanding  of  the  expected  Imaging  physics,  SNR  and  geometric  distortions  present. 

If  applied  blindly,  these  techniques  can  often  reduce,  rather  than  enhance,  guidance  updating  systems  per¬ 
formance. 

Because  of  the  inherent  deficiencies  in  nominal  signature  prediction  for  a  given  rensor  type  coupled  with 
map-matching  algorithm  limitations,  it  is  often  desirable  to  employ  adaptive  performance  prediction 
measures  to  estimate  the  quality  of  individual  fixes,  A  discussion  of  possible  performance  prediction 
techniques  for  guidance  updating  applications  and  then  limitations  is  given  in  Section  5.  2. 

Region  extraction  (12-22).  Obviously  homogeneous  regions  or  features  in  die  scene  cau  be  found  visually; 
however,  when  scenes  are  described  digitally  by  large  arrays  of  numbers,  it  is  highly  desirable  to  intro¬ 
duce  some  level  of  automation  into  the  process.  There  are  two  different  approaches  for  automatically 
extracting  regions  from  scenes:  1)  those  based  on  edge  operators  and  2)  those  based  on  the  stationarity  pro¬ 
perties  of  the  region. 

Edge  approaches  apply  gradient  or  Laplacian-type  operators  to  the  scene  and  then  use  threshold  techni¬ 
ques  to  decide  upon  the  existence  of  any  edge  (the  boundary  of  a  feature).  The  major  danger  in  using  these 
techniques  is  that  noise  and  distortion  can  make  it  very  difficult  to  locate  edges  in  the  sensor  imagery. 

Homogeneous  regions  may  also  be  located  using  the  statistical  property  of  stationarity  (first  order,  con¬ 
stant  mean  level  in  the  region;  second-order,  mean  and  variance  constant  and  autocorrelation  independent  of 
position).  In  this  area-based  approach, one  would  grow  regions  of  spatially  connected  pixels  which  would 
possess  this  property.  While  this  approach  is  less  susceptible  to  problems  of  noise  and  distortions  it  is 
computationally  more  complex  than  the  simpler  edge  operator  techniques. 

3.4  Scene  selection 

The  scene  selection  process  is  concerned  with  choosing  maps  for  which  the  probability  of  matching  a 
sensor  image  from  within  the  reference  map  boundary  is  high.  This  process  has  both  physical  and 
mathematical  implications.  There  will  obviously  be  signature  differences  between  the  sensed  image  and  its 
reference  map  counterpart  due  to  such  factors  as  geometric,  atmospheric,  meteorological,  diurnal,  and 


seasonal  effects.  These  effect*  on  system  perform&ncs  can  be  mu.<mized  in  die  extreme  by  either  pre¬ 
paring  the  reference  map  to  be  near  real-time  estimate  of  the  sensor  image  at  the  moment  iv  overflies  the 
reference  area  or  by  developing  scene  particular  algorithms  that  are  relatively  Invariant  to  the  signature 
deviations  between  the  sensor  image  and  reference  map.  Realistically  one  must  reach  a  comp.-omise 
between  these  two  extremes  and  develop  a  reference  map  which  will  reduce  the  signature  deviations 
especially  in  defining  the  boundaries  of  a  homogeneous  region  and  utilise  a  matching  algorithm  that  will 
compensate  for  any  remaining  signature  differences  between  the  two  maps. 

In  general,  successive  screening  techniques  from  eimple  math  tests  to  full-blown  simulations  are 
chosen  and  used  to  evaluate  the  candida  te  reference  area.  Since  computer  processing  requirements 
increase  considerably  with  each  screening  ei-.ep,  it  is  desirable  fc>r  unacceptable  reference  scenes  to  be 
identified  and  rejected  before  the  final  simulation  analysis  if  possible. 

The  mathematical  criteria  for  reference  scene  selection  requires  that  there  be  (1)  sufficient  Information 
for  map-matching  and  (2)  a  minimal  amount  ofintrascane  spatial  redundancy  within  die  reference  map 
boundary.  Techniques  exist  for  measuring  the  information  content  in  the  scene  to  ensure  that  the  sensor 
image  size  (in  terms  of  resolution  elements)  contain  a  sufficient  number  of  independent  elements.  The  more 
difficult  issue  and  yet  unresolved  is  the  determination  of  measure  for  scene  uniqueness.  Equipped  with  such 
a  measure  it  would  be  poscible  within  a  reference  map  boundary  to  test  the  ensemble  of  possible  sensor 
images  to  determine  the  amount  of  intrascene  spatial  redundancy. 

Heights  of  the  secondary  correlation  peaks  and  their  magnitude  determined  by  autocorrelation  a  particu¬ 
lar  sensor  map  over  the  reference  map  area  yield  the  location  of  areas  where  there  is  a  possible  spatial 
redundancy  problem.  Two  problems  emerge  from  attempting  to  use  this  as  a  measure  of  the  uniqueness 
problem.  First,  in  real  world  imagery  the  magnitude  of  die  intensity  level  shifts  within  the  imagery  may 
have  a  significant  impact  on  the  location  of  secondary  peaks.  Thus  this  approach  does  not  seem  fruitful  for 
measuring  scene  uniqueness.  Second,  this  approach  uses  texture  Information  within  a  region  which  may  or 
may  not  be  used  in  the  matching  algorithm;  consequently,  the  results  may  be  different  when  texture  informa¬ 
tion  is  omitted. 

The  underlying  spatial  patterns  in  the  map  as  designated  by  the  size  and  sh  pe  of  the  homogeneous 
regions  are  the  primary  concern  in  dealing  with  the  spatial  redundai.  cy  problem.  One  method  for  measuring 
scene  uniqueness  would  be  to  use  the  correlation  surface  associated  with  a  specialized  hybrid  algorithm  4s 
a  mean*  for  screening  reference  maps.  Here  the  reference  area  would  be  broken  up  into  homogeneous 
regiv  \s  and  each  pixel  within  the  region  would  be  replaced  by  the  mean  intern  'ty  level  of  the  entire  region. 

An  autocorrelation  of  a  particular  sensor  map  over  the  reference  map  would  be  performed  using  a  hybrid 
correlation  algorithm.  High  secondary  correlation  peaks  would  indicate  areas  where  spatial  scene 
redundancy  potentially  could  be  a  problem.  By  pulling  out  a  number  of  sensor  maps  from  the  reference  map 
boundary  and  repeating  this  process  one  could  determine  as  first-order  measure  the  uniqueness  properties 
of  the  reference  map. 

The  most  accurate  evaluation  procedure  uses  a  Monte  Carlo  simulation  to  provide  an  estimate  of  the 
update  circular  error  probability  (CEP)  and  Pff  for  a  given  reference  area  under  a  variety  of  conditions  (23). 
Samples  are  drawn  from  statistical  distributions  that  represent  vehicle  position-velocity  characteristics, 
and  are  used  to  specify  the  sensor  scene  location  within  the  reference  image.  Samples  from  another  distri¬ 
bution  are  used  to  specify  the  imaging  environmental  characteristics  present  (i.e.,  time  of  day).  An 
intensity  computation  for  the  specified  conditions  is  performed  for  each  subscene  location  by  using  the 
appropriate  signature  model.  Noise  terms  and  geometric  distortions  are  similarly  introduced  into  the 
sensor  scene. 

The  map-matching  operation  is  then  performed  between  the  reference  and  specified  synthetic  sensor  maps 
using  the  selected  matching  algorithm.  The  along  and  cross-track  difference  between  the  computed  and 
actual  (sensor  seem  draw)  match  point  locations  is  determined,  and  by  using  a  predetermined  criteria,  the 
update  is  catalogued  a*  either  a  good  or  false  fix. 

Since  each  of  the  variables  are  represented  by  statistical  distributions,  the  simulation  can  be  run  a 
specified  number  of  times  to  provide  CEP  and  Pff  estimates  over  the  range  of  expected  update  conditions. 
From  this,  the  reference  scene  suitability  for  guidance  updating  applications  can  be  determined  versus  a 
predetermined  performance  criteria. 

An  estimate  of  the  spatial  redundancy  present  within  the  reference  scene  is  provided  by  this  procedure 
since  the  location  of  the  sensor  scene  is  randomly  selected  from  within  the  reference  map  boundaries.  Like¬ 
wise,  estimates  of  the  impact  of  environmental.  geometric  and  SNR  effects  on  reference  mep  performance 
are  also  evaluated  by  this  procedure. 

It  should  be  recognized,  however,  that  the  quality  of  the  performance  estimate  provided  by  a  Monte  Carlo 
simulation  for  a  given  reference  area  is  generally  a  strong  function  of  die  preprocessing  and  map-matching 
algorithms  and  the  characteristics  of  the  environmental,  and  geometric  distortions  and  SNR  selected.  The 
use  of  different  preprocessing  or  map-matching  algorithms  for  reference  scene  evaluation  and  guidance 
updating  should  be  avoided  to  minimise  performance  degradations. 
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Any  uncertainty  in  specifying  the  random  variable  diatribution  properties  utilised  in  the  simulation  will 
result  in  a  decreased  confidence  in  the  reference  scene  evaluation  process.  If  large  uncertainties  exist  in  a 
given  variable  distribution,  it  is  better  to  eliminate  the  variable  from  the  simulation.  If  significant 
uncertainty  errors  are  present  in  several  distributions,  the  benefits  of  employing  this  form  of  reference 
scene  evaluation  decrease  and  the  resulting  performance  estimates  produced  are  often  unreliable. 


4.  Algorithm  selection  process 

Figure  5  describes  the  overall  algorithm  selection  process.  The  sensor  image  lo  generally  considered 
to  be  some  subset  of  the  reference  map  corrupted  by  errors.  A  matching  algorithm  is  then  used  to  locate 
the  position  Jt  the  sensed  image  in  the  reference  map  coordinate  system.  Based  on  an  analysis  of  system 
performance,  it  is  possible  to  determine  the  capability  of  each  algorithm  to  accommodate  various  types  of 
ei  ror.  Ultimately,  since  for  each  sensor  type  some  errors  are  more  dominant  than  others,  it  is  possible 
to  determine  the  most  appropriate  algorithm  for  each  sensor  type. 

This  section  will  discuss  the  following  topics:  (1)  a  description  and  categorisation  of  error  sources; 

(2)  a  description  and  classification  of  matching  algorithms;  and  (3)  an  analysis  of  the  compatibility  of  various 
algorithms  to  accommodate  different  error  sources. 

4.  1  Error  sources 

The  problems  associated  with  image  dynamics,  geometrical  distortions,  noise,  and  other  error  sources 
can  be  lumped  into  four  mutually  exclusive  comprehensive  categories.  These  categories  are  defined  as: 

1)  Global  errors--those  errors  which  uniformly  affect  the  intensity  level  of  all  scene  elements.  This 
category  would  include  geometric  distortions  and  bias  and  gain  changes. 

2)  Regional  errors--those  errors  where  the  charje  in  intensity  levels  occurs  uniformly  only  within 
homogeneous  regions  within  the  scene.  Examples  would  include  region-level  shifts  (contrast 
reversals)  due  to  image  dynamics  and  predictive  coding  errors  from  incorrect  reference  map 
construction. 

3)  Local  errors--errors  expected  to  affect  each  pixel  or  grouping  of  pixels  (contained  within  an 
interpixel  correlation  length)  independently.  The  primary  example  of  this  error  source  is 
additive  noise. 

4)  Nonstructured  errors--this  is  a  catchall  category  designed  to  fit  those  errors  whose  effect  on  the 
scene  can  not  be  described  as  being  global,  regional,  or  local  (an  example  being  a  cloud  cover  over 
portions  of  the  target  area  changing  the  signature  in  a  nonstructured  manner). 

The  advantage  of  this  formulation  of  the  error  source  is  that  by  grouping  errors  into  these  categories 
it  is  simpler  to  describe  the  utility  of  each  algorithm  relative  to  a  given  class  of  error  source  rather  than 
having  to  backtrack  and  deal  with  each  er ror/algorithm  combinouon  on  an  individual  basis. 


Reference  Image 


Appropriate 
Algo  rithm/ 
Sensor 
Combinations 


4.  2  Map-Matching  Altorlthm  Classes 


There  ara  three  classes  of  algorithms  which  can  be  employed  to  perform  the  image  matching  task.  These 
algorithms  include  correlation,  feature  matching,  and  hybrid  classes  (24). 
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All  algorithm*  perform  four  operation*:  (1)  transformation  of  the  original  Intensity  data  associated  with 
each  resolution  element  in  uoch  sensed  image  and  reference  map;  (2)  establishment  of  a  metric  for  com¬ 
paring  a  portion  of  the  reference  map  to  the  sensed  image;  (3)  the  computation  of  that  metric  for  all  possible 
position*  of  comparison  between  the  reference  and  sensor  maps;  and  (4)  a  selection  rule  (generally  the 
extremum  metric  value)  for  delineating  the  match  position  baaed  on  the  metric  value. 

Correlation  types  of  algorithms  use  the  intensity  values  associated  with  the  resolution  elements  of  each 
map  (of  some  transformation  of  these  intensity  values,  i»e. ,  normalization)  as  the  map  data  to  be  used  in 
computing  the  metric.  Correlation  metrics  measure  either  the  degree  of  similaritv  (i.  e. ,  product  type 
algorithm)  or  dissimilarity  (i.e. ,  difference  squared;  between  the  sensed  image  and  the  portion  of  the 
reference  map  it  is  being  compared  against. 

Feature  matching  algorithms  do  not  utilise  intensity  data  per  se  but  attempt  to  work  with  only  features  in 
the  scene  (2$).  This  is  generally  accomplished  by  using  algorithms  to  locate  boundaries  or  edges  between 
regions.  Edge  or  boundary  information  is  extended  to  determine  the  position  at  which  boundaries  or  edges 
intersect.  The  position  of  this  vertex  point  and  the  direction  and  number  of  line  segments  emanating  from 
the  vertex  point  form  the  basis  for  map  comparison*  with  the  metric  being  some  form  of  a  mean  square 
distance  measure  between  locations  of  vertices  in  the  reference  and  sensed  map.  This  distance  measure 
may  be  weighted  by  the  number  and  direction  of  line  segments  emanating  from  the  vertex  point  with  multiple 
intersecting  vertices  being  weighted  more  heavily. 

The  hybrid  algorithms  (26)  uses  a  combination  of  intensity  level  and  region  identlficatlr n  information  in 
determining  a  match  location.  In  this  class  of  Algorithm  homogeneous  regions  in  the  reference  scene  are 
identified  and  all  resolution  elements  within  the  region  are  tagged  as  belonging  to  the  region.  When  the 
sensor  is  compared  to  a  portion  of  the  reference  map,  an  assumption  is  made  that  this  position  of  compari¬ 
son  is  the  correct  one,  and  the  sensor  image  is  broken  up  into  homogeneous  region*  as  identified  by  the 
counterpart  elements  of  the  reference  map.  The  elements  in  each  region  are  correlated  separately  using  a 
correlation  algorithm,  and  the  total  correlation  between  the  two  maps  is  found  by  summing  the  individual 
correlations  taken  over  each  homogeneous  segment  of  the  reference  map. 

4.  3  Analysis  of  algorithm  compatibility 

Let  us  consider  which  class  of  algorithm  is  most  appropriate  for  accommodating  each  class  of  error 
source  separately.  Table  9  shows  a  rating  of  the  algorithm's  ability  to  accommodate  each  error  class. 
Examining  the  errors  relative  to  the  algorithms,  all  algorithms  can  readily  accommodate  global  errors. 
Correlation  and  hybrid  algorithms,  however,  probably  have  somewhat  more  difficulty  in  accommodating 
this  type  of  error.  Corrective  action  for  compensating  for  global  errors  nclude  processing  of  sensor  ele¬ 
ments  in  smaller  spatial  groups  to  accommodate  geometric  errors  (27-29),  normalization  of  intensity  levels 
to  compensate  for  bias  errors  and  gain  shifts,  and  extending  the  algorithm  ,  earch  dimension  to  include 
searching  the  scene  for  scale  and  rotational  effects.  Correlation  and  hybrid  algorithm  corrective  measures 
would  rely  most  heavily  on  spatial  grouping  and  intensity  level  compensation,  while  feature  matching  algo¬ 
rithms  (working  with  less  data  to  begin  with)  would  primarily  resort  to  search  techniques  to  compensate  for 
global  errors. 


Table  9,  Algorithm  Ability  to  Accommodate  Each  Class  of  Error 

Error  Class 


Algorithm 

Global 

Regional 

Local 

Nonstructured 

Correlation 

Medium 

Poor 

Good 

Good 

Feature 

Matching 

Good 

Good 

Poor 

Poor 

Hybrid 

Medium 

Good 

Medium 

Good 

Correlation  algorithms  are  extremely  poor  performers  in  the  prt  sence  of  regional  errors,  the  possible 
solution  being  (besides  switching  to  one  of  the  other  algorithms)  to  store  and  search  over  multiple  reference 
maps,  restrict  the  wavelength  of  the  imagery  to  spectral  regions  where  regional  errors  are  not  likely  to 
occur,  or  to  locate  reference  maps  in  geographical  areas  in  which  regional  errors  are  unlikely.  Both  the 
feature  matching  and  hybrid  class  of  algorithms  are  good  in  accommodating  regional  errors. 

Local  errors  such  as  noise  can  cause  significant  problems  in  the  performance  of  feature  matching 
algorithms  primarily  due  to  the  difficulty  in  extracting  features  of  line  boundaries  from  the  sensed  Imagery 
using  edge  type  operators.  Correlation  type  algorithms  are  virtually  immune  to  local  errors,  while  hybrid 
algorithms  are  susceptible  to  this  error  source  if  there  is  also  a  scene  redundancy  problem  with  noise, 
making  it  more  difficult  to  distinguish  Images  with  similar  spatial  patterns.  The  only  corrective  measure 
for  feature  matching  algorithms  in  the  presence  of  local  errors  is  to  switch  to  one  of  the  other  two  classes 
of  algorithms. 


Finally,  since  feature  matching  algorithms  use  less  Information  in  the  scene  than  the  other  two  types  of 
algo  ri*hmf ,  they  are  most  susceptible  to  nonstructured  errors  where  positions  of  the  sensed  image  may  look 
obliterated  when  compared  to  the  reference  map.  Correlation  and  hybrid  algorithm  t  can  still  perform  quit* 
well  even  in  the  presence  of  large  missing  areas  in  the  sensed  image. 

As  discussed  above,  each  algorithm  has  advantages  and  disadvantages  relative  to  certain  types  of  erroi 
sources;  however,  real  world  systems  are  likely  to  be  faced  with  a  combit:,.*  ?n  of  error  sources  to  deal 
with. 

From  the  discussion  In  Section  2,  it  is  seen  that  certain  sensor  bands  have  characteristic  errors  pri¬ 
marily  regional  (l.  e. ,  contrast  reversals  and  predictive)  errors  and  local  e:  rors.  Based  on  the  magnitude 
of  these  '.rrors  sources  (and  excluding  the  effects  of  global  and  nonstructure  *  errors)  it  is  possible  to  deter¬ 
mine  the  compatibility  of  sensors  with  matching  algorithms.  If  regional  ti.-cr s  dominate  the  process,  then 
a  feature  matching  algorithm  ia  most  appropriate.  If  local  errora  dominate,  t.ien  correlation  algorithms 
look  most  attractive.  In  the  presence  of  both  local  and  regional  errora  then  the  1  rid  class  of  algorithm 
looks  most  appropriate. 

To  summarize,  all  error  sources  can  be  placed  into  one  of  four  generic  categories.  Using  these  cate¬ 
gories  one  can  analyze  the  performance  of  die  three  types  of  algorithms  relative  to  a  particular  error 
source.  Some  algorithms  are  more  capable  than  others  at  accommodating  certain  daaaes  of  error.  In  the 
end  the  final  algorithm  choice  will  depend  os.  determining  the  weighting  of  the  error  sources  that  the  system 
is  likely  to  encounter. 

An  analysis  was  performed  to  determine  the  optimum  map-matching  algorithm  claas  for  each  sensor 
operating  band  based  on  the  regional  errors  given  in  Table  7,  as  well  as  sensor  characteristics  and  oper- 
ational  considerations.  The  results  of  this  analysis  are  summarized  in  Table  10.  Although  in  no  sensor 
case  is  one  algorithm  class  superior  to  the  others,  a  number  of  caveats  have  been  developed  and  presented 
as  a  guide  to  the  mission  planner  to  ensure  optimum  performance. 


Table  10.  Map-matching  algorithm  selection  based  on  designated  senaor  operating  region 


Sensor  Region 


Type 


Algorithm  Selection* 


Optical /Near  IR  P  fc  A 


Middle  IR 


P 


A 


-  Correlation  when  SNR  low 

-  Hybrid  when  SNR  moderate  and  vegetation  present 

-  Feature  matching  when  SNR  high  and  vegetation  absent 

-  Correlation  unacceptable  because  of  regional  thermal 
inertia  effects. 

-  Hybrid  when  SNR  low  to  moderate  and  vegetation  present 

-  Feature  matching  generally  undesirable  unless  high  SNR 
exists  and  vegetation  is  absent. 

-  Same  as  Optical /Near  IR 


Thermal  IR 


P 


-  Same  as  Passive  Middle  IR 


Microwave 


A 

P 


A 


Range  or  Phase  -  A 

Modulated  Sensors 


-  Same  as  Optical/Near  IR 

-  Correlation  when  SNR  low  and  microwave  reflectance 
dominates. 

-  Hybrid  when  SNR  moderate  and  vegetation  present 

-  Feature  matching  when  SNR  high  and  vegetation  absent 

-  Correlation  when  SNR  low  or  with  one -dimensional  imaging 

systems. 

-  Hybrid  when  SNR  moderate,  vegetation  present  or  with  two- 
dimensional  imaging  systsms. 

-  Feature  matching  generally  unacceptable  because  of  inade¬ 
quate  SNR  unless  specialized  preprocessing  used. 

-  Correlation  only  when 'low  SNF  present 

-  Hybrid  unnecessary  since  regional  errors  ere  generally 
■  mall. 

-  Feature  matching  desirable  when  SNR  high 


*  When  moderate  nonstructured  errors  or  snow/ice/water  are  present,  the  hybrid  approach  must  be  used 
with  all  systems  except  range  or  phase -modulated  sensers  to  enaure  update  reliability. 
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Correla'ion  l*  desirable  in  active  and  passive  optical/near  IR  cases  where  a  low  SNR  is  present.  Sources 
of  0»is  type  include  passive  low-light  level  operation,  low  scene  contrast  operation,  or  when  a  high  atmos¬ 
pheric  aerosol  content  is  present  in  the  imaging  path.  When  significant  vegetation  is  present  in  the 
reference  area,  the  hybrid  approach  is  desirable,  while  feature  extraction  is  reserved  for  cases  when  a  high 
SNR  exists  and  vegetation  that  exhibits  a  time-varying  regional  boundary  shift  is  absent. 

Correlation  class  algorithms  provide  unacceptable  performance  with  passive  middle  and  thermal  IR  and 
generally  with  passive  microwave  imagery  (when  microwave  emlttance  predominates)  due  to  contrast 
reversals  or  moderate  to  large  time-varying  regional  errors  induced  by  materia',  thermal  inertia  effects. 
Traditional  correlation  techniques, including  binary  conversion  preprocessing,  generally  provide  insignifi¬ 
cant  performance  improvement  when  applied  to  middle  and  thermal  IR  imagery  and  small  to  moderate 
improvements  with  passive  microwave  imagery.  The  hybrid  approach  is  preferable  in  cases  where  less 
than  a  high  SNR  exists  due  to  sensor,  imaging  contrast  or  atmospheric  reradiation  considerations,  or  when 
a  time -varying  vegetation  signature  is  present.  Feature  matching  application  is  operationally  limited  as  in 
other  spectral  regions  to  cases  where  a  high  SNR  exists  and  time-varying  vegetation  coverage  is  absent. 

Comments  given  for  the  optical /near  IR  region  are  generally  applicable  for  all  map-matching  systems 
using  active  sensors.  The  principal  limitations  of  active  middle  and  (particularly)  thermal  IR  systems  for 
applications  against  natural  materials  is  die  low  Imaging  contrast  typically  present.  It  is  often  necessary  to 
utilize  dynamic  range  expansion  preprocessing  techniques  with  these  sensor  types,  which  limits  the  use  of 
feature  matching  methods  in  these  cases  unless  a  high  data  SNR  exists. 

Although  atmospheric  effects  generally  have  a  negligible  impact  on  radar  image  contrast,  die  moderate 
to  low  SNR  typically  present  for  most  proposed  missi?  .‘-borne  systems  coupled  with  specular  material 
returns  from  the  reference  area  provide  other  problems  for  operational  map-matching  systems.  With  one¬ 
dimensional  radar  map-matchi  ig  systems  correlation  algorithms  are  usually  preferred  over  feature 
matching  to  minimize  the  number  of  discrete  scatters  required  to  ensure  adequate  performance.  Hybrid 
algorithms  are  preferable  when  a  moderate  SNR  exists  or  when  significant  vegetation  is  present  that 
possesses  a  time-varying  signature.  Feature  matching  algorithms  are  generally  unacceptable  for  pro¬ 
cessing  missile  borne  radar  data  because  of  typically  low  SNRs  unless  specialized  preprocessing  techniques 
are  used  which  emphasise  stable, while  deemphasising  potentially  unstable, edges  present. 

For  range  or  phase-modulated  sensors,  the  hybrid  approach  is  generally  unwarranted  (unless  a  signifi¬ 
cant  amount  of  deciduous  trees  exist)  because  of  the  generally  time -invariant  nature  of  these  forms  of 
reference  imagery.  The  choice  between  co.  relation  and  feature  matching  approaches  here  should  be  deter¬ 
mined  versus  the  expected  SNR  since  predictive  and  nonstructured  errors  are  generally  small. 

In  addition  to  the  caveats  just  presented,  it  should  be  recognized  that  other  error  types  sometimes  pre¬ 
sent  can  significantly  alter  map-matching  performance.  Correlation  and  feature  matching  algorithm  class 
performance  are  sensitive  to  predictive  (i.  e.  ,  snow/ice  /water  complex)  and  nonstructured  (i.  e. ,  shadowing) 
reference  map  errors.  In  the  event  that  a  high  probability  of  time  and  space-varying  snow /ice /water  or 
shadowing  exists  within  the  reference  area,  the  hybrid  algorithm  class  is  preferable.  The  only  practical 
exception  to  this,  allowing  adequate  correlation  or  feature  matching  performance,  would  involve  the  blockage 
of  only  a  small  amount  of  the  total  map  information  content  (i.  e. ,  number  of  independent  elements)  tnd/cr 
total  map  area. 

In  summary,  when  sensor  characteristics  or  operational  considerations  result  in  a  low  SNR  and  when  the 
selected  reference  area  has  a  relatively  time  invariant  signature,  correlation  class  algorithms  should  be 
considered.  When  a  moderate  SNR  exists  and  predictive  and  nonstructured  errors  are  expected,  the  hybrid 
class  is  preferable.  In  cases  where  a  high  SNR  exists  and  predictive  and  nonstructured  errors  are  small, 
feature  mapping  is  desirable. 


Performance  prediction 


Major  performance  considerations  for  image  matching  systems  involve  (1)  the  avoidance  of  false  fixes 
during  acquisition,  and  (2)  the  accuracy  with  which  the  position  fix  can  be  made.  The  major  focus  of  this 
paper  is  on  the  acquisition  phase  of  image  matching,  which  is  the  more  difficult  and  important  part  of  the 
overall  problem  to  be  solved.  The  acquisition  system  designer  relative  to  performance  measures  is  con¬ 
cerned  (1)  with  developing  general  guidelines  for  performance  as  a  function  of  sensor  and  computational 
algorithm  characteristics,  and  (2)  real-time  scene  dependent  estimates  of  system  performance  in  order  to 
determine  whether  or  not  a  position  fix  is  valid.  This  section  is  therefore  divided  into  two  parts:  one 
dealing  with  the  general  development  of  performance  guidelines  for  acquisition  and  the  other  dealing  with 
adaptive  techniques  for  estimating  system  performance  in  real-time  onboard  the  vehicle. 


5.  1  Performance  guideline 


As  pointed  out  above,  the  performance  criteria  for  acquisition  is  concerned  with  the  avoidance  of  false 
fixes  as  measured  by  its  probability  of  occurrence,  Pff.  Developing  eome  general  theoretical  guidelines  in 
this  area  avoids  the  expenses  associated  with  developing  guidelines  completely  from  Monte  Carlo  simula¬ 
tions.  The  general  theoretical  development  of  determining  Pff  or  P_  (l  -  Pff))  begins  with  examining  the 
correlation  surface  shown  in  Figure  6.  The  correlation  values  can  be  broken  into  two  groups--those  asso¬ 
ciated  with  match  and  nonmatch  correlation  values,  a  (J),  which  are  located  away  from  die  central  paak.  As 
sean  in  Fig  we  4  these  correlation  values  can  be  compactly  represented  by  two  statistical  distributions --one 
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ss  soclatsd  with  tha  nonmatch  values  and  on*  associated  v.  ith  the  match  value(e).*  Tha  correlation  valoo(a) 
aaaoclatod  with  tha  eorract  match  point  may  also  taka  on  a  dlatrlbution  of  valuaa  duo  to  nolaa  and  othar 
arrora  (anch  aa  gaomatrlc)  In  tha  ayatam.  Errors  will  hava  a  tandancy  to  spread  out  both  tha  match  and 
nonmatch  cot  relation  distribution*.  Tha  computation  of  tha  parformanca  maaaura  Involvaa  determining  tha 
probability  that  a  correlation  value  drawn  from  tha  dlatrlbution  aaaoclatod  with  the  match  point  axeaeda  all 
correlation  valuaa  drawn  from  di  rlbution  aaaociatad  with  nonmatch  valuaa. 


NON  MATCH  POSITIONS  MATCH  POSITION  NON  MATCH  POSITIONS 


Mathematically  thla  can  be  expressed  aa  the  general  expression  shown  in  Figure  7,  where  It  la 
necessary  to  compute  for  a  given  match  correlation  value  the  probability  that  the  match  correlation  value 
exceeds  the  nor  r.etch  correlation  value  for  all  nonmatch  positions  of  comparison  (Q)  between  the  aanaad 
image  and  reference  maps  with  this  expraaaloa  being  weighted  by  tha  distribution  associated  with  tha  match 
values  (30.  31),  If  tha  match  and  nonmatch  correlation  values  are  indeed  Independent,  titan,  as  shown  in 
step  2  of  Figure  7,  tits  probability  expression  can  be  computed  using  two  separata  dlatrlbution  functions* -one 
for  the  match  value  and  one  for  all  the  nonmatch  values. 

In  the  real  world  there  are  generally  epatial  patterns  in  the  eensed  imagery  which  ere  partially  repeated 
in  some  position  of  the  reference  map.  This  scena  inter  redundancy  problem  can  be  a  major  source  of 
syetem  failures  when  compounded  by  noise  end  other  error  sources.  It  alao  generally  causae  tits  correla¬ 
tion  value  at  tome  nonmatch  points  to  be  highly  dependent  on  the  match  correlation,  thus  prevonting  the  two 
distributions  to  be  separated  end  requiring  a  joint  dlatrlbution  expression  to  bo  used  in  computing  the  proba¬ 
bility  that  a  nonmatch  correlation  value  exceeds  the  match  correlation  value.  If  one  attempts  to  be 
mathematically  correct  in  modeling  this  scene  inter  redundancy  problem,  tits  expression  involving  the  joint 
dlatrlbution  function  (for  match  and  nonmatch  values)  causes  one  into  a  scene  specific  "modus  operand!"  with 
a  probability  expression  which  U  too  complicated  to  derive  general  results  f  rom. 


Moat  authors,  in  attempting  to  develop  e  general  Pc  guideline,  have  Ignored  the  implications  of  the  ecene 
redundancy  and  have  assumed  the  match  and  nonmatch  correlation  values  to  be  independent.  The  implies- 
of  avoiding  to  model  the  lnterecene  redundancy  problem  ere  twofold.  First,  end  foremost,  the  analysis 


•Dos  to  correlation  in  the  scene  elements  themselves  several  valuaa  around  the  correct  match  peuk  may  be 


which  follows  to  determine  th«.  Pc  guidelines  should  bs  consldsrsd  s  limiting  csss  whsrs  aolss  sad  othsr 
appropriately  modaltd  srrors  domlasts  ths  failure  mods.  For  situations  whsrs  ths  scons  sal  set!  on  pro- 
c,h(i  hava  dona  a  good  job  In  screening  out  ths  scans  redundancy  failure  mods,  the  analysis  could  still 
provide  useful  performance  guid  lines.  If,  however,  sufficient  effort  was  not  made  in  properly  selecting 
reference  maps  to  avoid  scene  redundancies,  system  performance  is  likely  to  be  significantly  worse  than 
predicted  by  these  guidelines.  Second,  other  approximations  and  assumptions  beyond  this  point  take  on  less 
significance. 


CORRELATION 

DISTRIBUTIONS 
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Returning  to  Figure  7,  in  order  to  achieve  the  next  level  of  simplification  from  tho  ganoral  oxproaslon  it 
is  uocessary  to  assume  ell  nonmatch  correlation  values  are  independent.  Two  factors  invalidate  this 
assumption.  First,  ths  nature  by  which  some  computational  algorithms  (i.e. ,  Mean  Absolute  Difference 
(MAD)i  process  the  map  elamants  leads  to  adjecent  corralatlon  values  being  correlated  and  hanca  not 
independent.  This  problem  can  be  overcome  by  the  avoidance  of  this  type  of  algorithm.  Another  problem 
arises  from  the  feet  that  real  world  scvr.a  elements  are  almost  always  correlated  which  leada  to  their 
associated  correlation  values  being  correlated.  This  problem  esn  be  overcome  by  modeling  ths  ecene  to  be 
composed  of  s  number  of  independent  elements  (less  than  ths  total  number  of  scons  sis  mental  estimating  the 
number  of  equivalent  independent  elements  in  the  scene,  end  using  this  number  in  the  Pe  computation  pro¬ 
cess.  Here  not  only  must  the  scene  be  seeled  by  the  correlation  length  factor,  but  equivalent  scaling  must 
be  performed  on  die  number  of  nonmatch  comparison  points. 

Further  simplification  of  the  expression  step  3  to  stop  4  requires  all  the  nonmatch  correlation  values  to 
be  identically  distributed.  In  general  ths  heterogeneous  nature  of  scene  structure,  i.  o. ,  die  scone  being 
composed  of  homogeneous  regions  with  different  mean  intensity  values,  can  negate  this  assumption.  Ths  use 
of  algorithma  which  tend  to  homogenise  ecenet  (euch  as  the  hybrid  algorithm)  can  overcome  thia  difficulty 
end  make  this  assumption  more  realistic. 

Since  correlation  values  involve  die  summing  of  e  large  somber  of  random  variables  (some  combination 
of  die  scans  elements)  ths  central  limit  theorem  can  be  invoked  to  simplify  the  expression  in  step  4  further. 
This  assumption  implies  that  ths  distribution  of  At  match  and  nonmatch  correlation  values  is  Gaussian, 
finally,  a  further  approximation  can  be  applied  to  obtain  a  closed  form  exproasion  for  die  performance 


Tc  <nmmitiit|  on*  cannot  develop  *  useful  g*n*r*l  expression  for  computing  Pc  in  th*  presence  of 
scene  inter  redundancy  problems  end  other  external  error  eourcee  such  es  noise  end  distortions.  If  one  cen 
ignore  die  scene  redundancy  p^oblam  by  e  stringent  scene  selection  process,  it  ie  possible,  using  e  series 
of  epproxlmetions  end  assumptions ,  to  develop  e  Pc  expression  which  yields  guidelines  for  system  per* 
formence  in  th*  presonce  of  noise  end  other  error  sources.  The  remeinder  of  this  section  will  ex* min* 
developing  edeptlve  techniques  for  estimeting  system  performenue  from  the  correletion  surfece  itself. 


In  order  to  ensure  mission  effectiveness  end  sefe  werheed  erming,  e  criterie  to  estimate  whother  the 
guidence  updete  is  eccepteble  or  not  is  desireble.  One  proposed  technique  involves  e  voting  logic  with  three 
successive  updete  scenes.  Here,  die  determined  fix  point  of  two  of  the  three  correleted  scenee  must  be 
metched  within  en  eccepteble  bound;  else  the  fix  sequence  is  rejected  for  guidence  updeting.  Although 
simple  to  Implement  end  suiteble  for  us*  with  reletively  Inver  lent  reference  erean,  this  technique  breaks 


down  when  die  updete  ere*  is  miseed  eltogether;  or  when  signiflcent  v evictions  from  die  expected  scene 
signeture  exist  diet  cen  not  be  modeled  h  priori.  When  coupled  with  the  inherent  modeling  llmltetlons  of 
most  sensor  opereting  bends,  this  technique  does  not  provide  any  lndicetion  of  the  uncerteinty  of  the 
indlvlduel  fixe*. 


'  Two  be  sic  techniques  exist  which  ere  cepeble  of  providing  e  better  performer  >  vs  ti  mate  of  updete  quellty. 
The  first  involves  the  enelyeis  of  the  distribution  of  die  rew  sensor  scene  dete.  Ilndur  conditions  of  cloud 
cover  or  surfece  enow /ice /wet* r  die  resulting  standard  d eviction  of  th*  distribution  will  often  epproech  thet 
of  th*  noise  equivelent  (spectrel)  power  of  the  sensor  Itself,  and  thus  will  be  substantially  smeller  than  that 
,i  from  die  unexpected  updete  area.  If  e  multimodel  (histogram)  distribution  exists  where  the  mean  end 
standard  deviation  of  e  region  ere  substantially  different  then  expected,  the  suspect  points  cen  be  labeled 
before  further  processing.  When  the  ratio  of  the  number  of  total  imaged  point*  vereue  those  in  the  suspect 
distribution  region  each  a  predetermined  value,  the  image  cen  be  deleted  from  die  updete  or  voting  process. 

A  more  reliable  technique  involves  computing  the  correletion,  hybrid  or  feature  extraction  surface,  then 
using  properties  or  statistics  of  thet  distribution  for  estimeting  updete  performance.  A  list  of  theoe 
technique*  in  order  of  increasing  reliability  is  given  in  Table  11. 

Table  11.  Statistical  Match  Surface  Methods  for  Estimating  Fix  Quality* 

1.  Main  peak  amplitude 

2.  Main  peak  to  first  or  highest  sidelobe 

amplitude  ratio. 

3.  Main  peak  amplitude  vs  background  statistics  ratio 

4.  Statistics  of  main  peak  vs  background 

5.  Above,  with  compensation  for  inter-point 

scene  correlation  and  algorithm  contribution. 

6.  Above,  with  homogeneous  region  segmentation 

of  reference  scene. 


^Methods  in  increasing  order  of  effectiveness 


i 


While  all  six  approaches  can  be  used  with  correlation  or  hybrid  algorithms,  only  th*  first  three  are 
compatible  with  feature  matching  techniques.  (As  given  in  Table  li,  the  sixth  and  most  accurate  approach 
for  fix  performance  estimation  directly  incorporates  die  hybrid  algorithm. )  An  analytical  relationship 
between  surface  statistics  and  original  scene  properties  may  not  exist  because  of  the  use  of  edge  or  vertex 
data  for  matching  with  feature  matching  techniques.  In  either  case,  a  decision  threshold  bassd  on  surfece 
properties  or  statistics  for  fix  acceptability  must  be  determined  4  priori  from  accurate  simuletion  of  the 
update  erees.  The  first  three  ceses  er*  simple  to  implement,  and  utilise  the  main  paak,  its  ratio  with  the 
first  or  highest  sidelobe  peak  or  its  ratio  with  tfea  surface  background  statistics. 

Th*  first  case  uses  th*  amplitude  of  die  main  paak  and  is  generally  unreliable.  It  is  highly  dependent  on 
Iha  imaged  "information  content"  (i.  a. ,  Nj)  which  can  vary  significantly  with  environmental  distortions  and 
SNR.  The  second  utilises  die  ratio  of  die  main  to  first  or  highest  sidelobe  peaks.  It  is  generally  unreliable 
unless  th*  ratio  ia  vary  high  or  low.  For  realistic  intermediate  cases,  the  ratio  will  oscillate  considerably 
due  to  environmental  distortions  and  SNR  variations.  Although  an  improvement  over  preceding  cases,  using 
die  ratio  of  die  main  peak  versus  background  statistics,  can  often  bs  unrsliable  because  estimates  of  the 
original  refersnes  and  sensor  acana  statistical  preparties  are  omitted  which  impact  the  matching  surface, 
hence  this  ratio. 


Th*  final  three  approaches  of  varying  degrees  of  completeness  determine  a  probability  of  correct  match 
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The  fourth  case  utilises  estimates  of  the  main  peek  end  background  etetlatice  to  determine  the  degree  of 
eeparation  between  In  end  out  of  register  dietrlbutlona  (hence  Pc).  Although  an  improvement  ovur  the 
preceding  cases,  it  doee  not  utilise  eetimatee  of  the  original  scene  statistics  and  la  also  biased  by  the 
matching  algorithm  itself.  An  example  of  this  case  ia  the  Bhattachryya  distance.  In  the  next  case,  com¬ 
pensation  is  made  for  both  the  interpoint  scene  correlation  and  the  impact  of  the  matching  algorithms  on  the 
surface  statistics.  If  level  shifts  between  regions  in  the  update  area  do  exiat,  this  approach  can  he  very 
accurate. 

The  last  approach  utilises  the  methodology  of  the  previous  case,  but  with  region  segmentation  for  hybrid 
processing.  Here,  die  reference  scene  la  segmented  into  homogeneous  regions  and  matched  against  the 
unaegmented  sensor  image.  Sitice  diurnal  or  seasonal  level  shift  variations  occur  in  most  spectral  Imagery, 
compensation  to  region  boundaries  ie  generally  required  to  ensure  die  accuracy  of  fix  quality  estimates.  The 
hybrid  approach  is  generally  more  reliable  than  one  which  segments  both  referenca  and  senaor  scenes  before 
processing;  since  this  method  tends  to  amplify  environmental  and  SNR  induced  region  boundary  distortions. 

It  is  estimated  that  this  hybrid  algorithm  has  considerable  utility  in  fix  quality  evaluation;  since  it  incorpo¬ 
rates  the  statistical  properties  of  both  the  original  and  correlated  reference  and  sensor  scenes. 

6. 0  Summary 

This  paper  advances  seven  m^jor  points.  First,  there  are  map  difference  errors  between  the  reference 
map  and  sensor  image  which  have  time  and  spatial  varying  components.  The  magnitude  of  these  errors  is 
highly  sensor  wavelength  or  frequency  dependent;  however,  the  statistics  of  the  map  difference  errors  can 
be  quantified  for  each  sensor  wavelength  as  a  function  of  the  matorial  properties  of  the  scene. 

Second,  an  important  aspect  of  the  problem  is  to  choose  and  to  evaluate  reference  maps  to  avoid  us  log 
areas  which: 

1)  do  not  contain  sufficient  information, 

2)  have  a  scene  redundant  problem,  and 

3}  have  materials  at  a  wavelength  under  investigation  with  large  signature  oscillations. 

Third,  grouping  errors  and  algorithms  into  die  generic  classes  indicated  in  this  paper  simplifies  the 
analysis  and  enables  din  problem  to  be  structured. 

Fourth,  certain  algorithms  can  accommodate  certain  classes  rf  errors  more  readily  than  other  types  of 
algorithms.  As  certain  sensor  wavelengths  have  a  class  of  errors  which  dominate,  it  ie  possible  to  pre¬ 
determine  which  algorithm  is  moat  appropriate  for  dealing  with  scene  data  at  a  given  sensor  wavelength. 

This  paper  defines  those  algorithm/sensor  wavelength  relationships  for  several  specific  operational  condi¬ 
tions. 


Fifth,  the  computation  of  the  probability  of  correct  match  is  scene  dependent,  and  hence  any  generalisa¬ 
tion  must  be  considered  an  approximation.  Since  no  absolute  Pc  measures  can  be  determined,  it  is  not 
useful  to  develop  optimal  algorithms  based  on  mathematical  approximations  to  die  general  formulation. 
The  more  appropriate  problem  ia  to  obtain  the  correct  algorithm  for  accommodating  the  mep  difference 
errors  which  are  anticipated  to  occur  and  not  to  worry  about  which  sub-class  of  algorithm  is  mathematically 
optimal  for  the  ideal,  nonreal  world  case. 

Sixth,  it  ia  possible  to  improve  die  process  of  updating  missile  position  by  using  map-matching  surface 
data  to  estimate  in  real-time  the  performance  of  the  system.  These  estimates,  while  approximations,  have 
proven  through  experimentation  useful  in  separating  true  matches  from  false  matches  and  can  be  used  in 
weighting  the  accuracy  of  the  fix  position. 

Seventh,  a  new  class  of  map-matching  algorithm,  the  hybrid  algorithm,  was  presented  which  incorporates 
many  of  the  advantages  associated  with  the  feature  matching  algorithms  while  avoiding  many  of  the  pitfalls 
associated  with  extracting  features  from  noisy  sensor  images.  It  was  shown  to  have  a  significant  utility  in 
dealing  with  a  large  number  of  map  difference  errors. 


Conclusions  and  recommends 


The  major  stumbling  block  in  analysing  map-matching  systems  is  the  "scene.  "  Variations  in  the 
temporal  and  spatial  characteristics  of  scenes  mitigate  die  need  for  high- o.'der  algorithm  refinement  and 
Invalidate  sophisticated  math  modeling  of  the  process.  Such  variations  in  scene  imagery  are  the  major 
problems  in  developing  an  automated  system.  Two  major  entities  are  required  to  deal  with  the  problem: 

(1)  the  establishment,  and  (2)  an  analysis  of  a  data  base  devoted  exclusively  to  the  image  dynamics  probl  % 


A  data  base  should  be  created  for  each  eensor  wavelength  enumerated  in  this  paper.  The  data  base 
should  consist  of  (1)  a  statistically  representative  set  of  reference  maps  covering  die  range  of  expected 
materials,  material  interfaces  and  target  types  likely  to  be  encountered,  (2)  an  accompanying  set  of  sensor 
images  (contained  within  the  reference  map  boundary)  which  reflect  the  range  of  expected  temporal  signa¬ 
ture  variations,  and  (3)  a  library’  of  the  physical  and  wavelength  dependent  electrical  properties  of  "common" 
scene  materials. 


Having  developed  such  a  data  base  it  is  than  necsaatry  to  statistically  quantify  tha  nature  of  the  acene 
errora  present.  Baaed  on  this  quantification,  the  moat  appropriate  algorithm  daea  and  preproceeaing 
choice  for  a  particular  wavelength  (and  possibly  target  type)  can  be  determined.  Finally,  after  evaluating 
eyctem  performance  over  tha  expected  range  of  acane  errora  and  operational  conetralnte  It  would  be  poaai- 
ble  to  determine  which  aenaor  wavelength*  are  moat  appropriate  for  the  Image  matching  tasks. 
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App.mdlx 

Texture 

The  concept  of  texture  from  a  scene  composition/sensor  resolution  description  has  previously  been  intro¬ 
duced.  It  is  of  interest  to  explore  the  source  of  the  textural  spectral  signature  variations  present  on  a  time 
and  space-varying  basis  within  sensor  imagery.  Texture  is  effectively  produced  by  two  different  types  of 
phenomena. 

In  the  first  case,  a  material  of  different  physical  or  electrical  properties  than  its  neighbors  exists  within 
the  scene.  If  it  occupies  one  or  more  scene  elements  it  will  be  resolved  within  the  sensor  image.  It  is  also 
possible  to  resolve  this  material  on  a  subelement  basis  if  its  area  times  radiance  is  greater  than  that  from 
all  other  materials  within  the  element,  and  if  the  resulting  radiance  is  above  the  detectors  SNR. 


In  the  second  case,  a  truly  homogeneous  material  may  exist  within  a  region  virtually  independent  of 
resolution  (i.  e. ,  dry  beach  sand).  Texture  may  still  be  present  due  to  three  factors. 

The  first  is  the  slope  and  slope  azimuth  of  the  material  relative  to  the  sun  (or  illuminator)-target-sensor 
geometry.  It  is  possible  for  areas  with  moderate  slopes  (20°—  30°)  to  produce  substantially  more  or  less 
radiance  depending  on  their  orientation  between  illumination  source  and  detector  (this  is  especially  impor¬ 
tant  when  direct  (i.  e. ,  laser  or  sun)  versus  diffuse  (i.  e.  ,  skylight)  irradiance  exists). 

For  imaging  lasers  and  radars,  slope  and  slope  azimuth  between  the  illuminator-target-detector 
geometry  significantly  impacts  the  magnitude  of  the  returned  target  radiance.  At  least  here,  versus  a 
passive  system,  the  illuminator  is  usually  co-located  near  the  detector.  The  net  effect  of  this  is  to  simplify 
the  governing  geometry  for  determining  the  return  vector  of  the  propogated  wave.  Weak  to  moderate 
reflectors  oriented  at  steep  incident  angles  to  a  co-located  transmitter /detector  can  often  produce  a  signifi¬ 
cantly  greater  return  than  strong  reflectors  oriented  less  favorably. 

For  passive  systems  where  the  illuminator  (usually  the  sun)-vehicle  geometry  is  generally  not  co-located, 
shadowing  is  more  difficult  to  evaluate.  Here,  shadowing  is  often  a  problem  due  to  the  time-varying  sun- 
target  geometry  coppled  with  slope  and  slope  azimuth,  and  surface  roughness  of  the  reference  area.  As  a 
consequence,  shadowing  can  significantly  impact  daytime  optical/near  IR  and  middle  IR  imagery  where  a 
strong  solar  component  exists.  Its  effect  in  the  thermal  IR  region  is  to  prevent  direct  incident  short  wave¬ 
length  radiation  from  being  absorbed  by  the  target,  thus  reducing  the  diurnal  temperature  oscillation  by 
weakening  the  thermal  inertia  driving  function.  Because  of  the  diffuse  nature  of  passive  microwave  radi¬ 
ation,  the  effect  of  shadowing  on  apparent  brightness  temperature  is  generally  not  a  problem  within  a 
reasonable  range  of  antenna  depression  angles  with  this  form  of  imagery  for  water  and  metal  because  of 
their  moderate  to  high  microwave  reflectances  respectively.  For  materials  with  high  microwave  emittances, 
shadowing  weakens  the  thermal  inertia  driving  function  for  diurnal  temperature  oscillation,  and  can  reduce 
the  emissive  power  and  the  resulting  observed  apparent  brightness  temperature. 

As  with  active  illuminator  systems,  slope  and  slope  azimuth  play  an  important  role  in  many  passive 
imaging  systems.  In  the  optical/near  IR  and  middle  IR  regions  it  impacts  the  returned  target  radiance 
similarly  to  active  systems, although  to  a  greater  extent  because  of  the  varying  solar-target  geometry.  Slope 
and  slope  azimuth  also  produce  differential  heating  from  absorbed  short  wavelength  solar  radiation,  which 
can  have  a  moderate  to  strong  impact  on  night-time  middle  IR  and  diurnal  thermal  IR  imagery  and  a  small  to 
moderate  effect  on  diurnal  passive  microwave  imagery  when  a  high  microwave  material  emittance  exists. 

The  necond  parameter  that  can  produce  image  texture  is  the  material  reflection  coefficient  or  reflectance. 
A  variation  in  smooth  surface  reflected  energy  versus  incidence  angle  exists  due  to  (real  and  imaginary) 
material  electrical  components.  Because  material  reflectance  is  the  dominant  energy  balance  parameter  in 
several  speci.-v'  regions,  its  directional  characteristics  can  have  a  significant  impact  on  the  amount  of 
energy  returned  lrom  a  target.  The  real  component  is  the  material  dielectric  component,  while  the  imagi¬ 
nary  one  equals  th-  electrical  conductivity  divided  by  the  angular  frequency  times  the  free-space 
permittivity.  For  conductors  (i.  e. ,  bare  metals),  the  second  component  generally  predominates.  For 
dielectrics  (most  natural  materials)  the  first  term  is  usually  dominant  since  negligible  electrical  conduc¬ 
tivity  exists. 

Given  the  electrical  component  values,  the  vertically  or  horizontally  polarized  directional  reflectance  for 
a  smooth  material  can  be  determined  from  Fresnel's  equations  at  a  particular  wavelength  (34).  The  values 
computed  by  Fresnel's  equations  provide  a  measure  of  theoretical  material  reflectance  versus  incident  and 
reflecte'1  -  'glee.  Surface  roughness  height  and  orientation  can,  however,  significantly  impact  the  amount  of 
radianr  tually  reflected  (or  absorbed)  by  the  material. 

Consequently,  the  third  parameter  of  interest  is  the  roughness  of  the  surface  itself.  For  the  same 
illumination  source-detector  geometry  multiple  reflections  will  occur  within  the  material  when  the  roughness 
height  to  wavelength  ratio  is  large.  This  results  in  an  increase  in  absorptance  and  a  consequent  increase  in 
emittance  in  wavelength  regions  where  this  parameter  Is  relevant.  When  the  ratio  of  roughness  height  to 
wavelength  is  small,  multiple  reflection  effects  diminish,  and  the  resulting  absorptance  decreases  to  a 
theoretical  minimum  for  the  material. 
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The  directional  and  bidirectional  reflectance*  of  a  material  in  a  given  wavelength  region  are  dependent  on 
the  surface  roughness  as  well  as  the  governing  electrical  relationship.  Unfortunately,  it  is  difficult  to 
characterise  surface  roughness.  The  root  mean  square  (rms)  roughness  sometimes  used  provides  no  infor¬ 
mation  pertaining  to  the  statistical  distribution  of  roughness  around  the  rms  value  and  the  average  slope  of 
the  sides  of  the  roughness  peaks,  although  they  can  significantly  influence  directional  and  bidirectional 
reflectance  (34).  As  a  result  the  directional  and  bidirectional  reflectance  characteristics  that  some 
materials  exhibit  are  due  to  a  combination  of  complex  surface  structure  and  surface  impurities  (i.  e. ,  iron 
oxide  or  moss)  present  together  with  the  materials  Inherent  electrical  properties. 

Surface  roughness  significantly  impacts  the  returns  from  imaging  lasers  and  radars  depending  on  the 
relevant  geometry.  When  a  shallow  incidence  angle  exists  between  the  illuminator  and  target,  the  net 
effect  for  rough  surfaces  is  often  to  return  more  radiance  than  from  a  smooth  one  because  of  the  effective 
presence  of  material  corner  reflectors.  This  is  evident  in  radar  data  when  examining  imagery  from  smooth 
versus  rough  fields  or  water.  At  steep  incidence  angles,  the  reverse  is  true.  Here,  a  smooth,  surface  will 
generally  return  more  radiance  than  from  a  rough  one. 

Surface  roughness  can  also  impact  the  returned  target  radiance  in  the  optical/near  IR,  and  to  a  lesser 
extent  in  the  middle  IR  region,  because  of  the  predominance  of  the  direct  solar  illumination  component.  The 
effects  are  similar  to  those  discussed  under  active  Illuminator  systems.  In  the  thermal  IR  region,  an  insig¬ 
nificant  amount  of  direct  energy  radiated  by  the  sun  reaches  the  surface  and  generally  high  emittance  exist 
for  most  natural  materials  (typically  .  65  to  .  99).  As  a  consequence,  the  net  effect  here  is  to  impact  the 
short  wavelength  absorptance  and  possibly  the  material  thermal  inertia. 

In  the  passive  microwave  imagery  where  high  emittance  materials  are  present  which  have  a  surface 
roughness  substantially  greater  than  the  imaging  wavelength,  effects  similar  to  those  in  the  thermal  IR 
can  exist.  Many  materials  such  as  metal,  concrete,  asphalt  and  smooth  water  behave  specularly  in  the 
passive  microwave  region  (particularly  at  frequencies  below\40GHz)  because  their  surface  roughness  is 
small  in  comparison  'jo  the  imaging  wavelength.  '  An  interesting  case  of  the  effect  of  surface  roughness  on 
material  reflectance  in  this  region  occurs  with  water.  Calm  water  behaves  as  a  good  specular  reflector  of 
passive  microwave  radiation  (second  only  to  metal  in  this  wavelength  region).  As  surface  roughness 
increases,  the  magnitude  of  the  sky  radiation  times  microwave  material  reflectance  term  decreases  due  to 
multiple  reflections  present.  As  a  consequence,  the  emittance  times  the  ground  (water)  temperature  term 
predominates  in  rough  water  where  capillary  waves  exist,  and  emissive  power  variations  under  clear  skies 
can  be  on  the  order  of  20%  to  30%  between  this  and  the  smooth  water  case. 


